2024-04-26T21:24:55.269 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T21:24:55.269 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc} --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220 --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/orig.config.yaml 2024-04-26T21:24:55.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T21:24:55.408 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220 branch: wip-rishabh-testing-20240426.111959 description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc} email: null first_in_suite: false job_id: '7675220' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds inject traceless reply probability: 0.5 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoipGnaObwJKVsknoMvVL7UoO4eYn6G3zWZCMshjUIGNN1vekOT15HLHDU5nj4WM24qq0ocYu41U7NH/GaA8IA= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6Rxo8Qq5zUJioo4/nhjMEx053If3+OQGv32gElKoPqL41ZN+Z33jyH9FTYtIHo4v11oqy2VZEAQKcNZ9ruFNg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T21:24:55.408 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T21:24:55.409 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T21:24:55.409 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T21:24:55.411 INFO:teuthology.task.internal:Checking packages... 2024-04-26T21:24:55.436 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T21:24:55.436 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:24:55.436 INFO:teuthology.packaging:ref: None 2024-04-26T21:24:55.436 INFO:teuthology.packaging:tag: None 2024-04-26T21:24:55.436 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T21:24:55.436 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:24:55.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T21:24:55.650 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T21:24:55.651 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T21:24:55.658 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T21:24:55.658 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T21:24:55.665 INFO:teuthology.task.internal:Saving configuration 2024-04-26T21:24:55.682 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T21:24:55.688 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T21:24:55.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:19:49.456280', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoipGnaObwJKVsknoMvVL7UoO4eYn6G3zWZCMshjUIGNN1vekOT15HLHDU5nj4WM24qq0ocYu41U7NH/GaA8IA='} 2024-04-26T21:24:55.735 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:19:49.454812', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6Rxo8Qq5zUJioo4/nhjMEx053If3+OQGv32gElKoPqL41ZN+Z33jyH9FTYtIHo4v11oqy2VZEAQKcNZ9ruFNg='} 2024-04-26T21:24:55.736 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T21:24:55.742 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T21:24:55.742 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-26T21:24:55.742 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T21:24:55.806 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac1a16cf70>, signals=[15]) 2024-04-26T21:24:55.807 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T21:24:55.815 INFO:teuthology.task.internal:Opening connections... 2024-04-26T21:24:55.815 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T21:24:55.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:24:55.910 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:24:55.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:24:55.985 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T21:24:55.992 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-04-26T21:24:56.011 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-04-26T21:24:56.011 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-04-26T21:24:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-04-26T21:24:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-04-26T21:24:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-04-26T21:24:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-04-26T21:24:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-04-26T21:24:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-04-26T21:24:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T21:24:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-04-26T21:24:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-04-26T21:24:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T21:24:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-04-26T21:24:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T21:24:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T21:24:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T21:24:56.071 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-04-26T21:24:56.147 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-26T21:24:56.165 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-26T21:24:56.166 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-26T21:24:56.223 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T21:24:56.224 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T21:24:56.225 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-26T21:24:56.255 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T21:24:56.265 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T21:24:56.272 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T21:24:56.272 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-04-26T21:24:56.274 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-04-26T21:24:56.291 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T21:24:56.303 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T21:24:56.303 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-04-26T21:24:56.332 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-04-26T21:24:56.392 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T21:24:56.444 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T21:24:56.459 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T21:24:56.459 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T21:24:56.459 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T21:24:56.460 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T21:24:56.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:24:56.478 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:24:56.478 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T21:24:56.478 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-04-26T21:24:56.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:24:56.479 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:24:56.480 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T21:24:56.480 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-04-26T21:24:56.535 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-437.el9.x86_64 2024-04-26T21:24:56.536 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:24:56.536 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T21:24:56.536 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:24:56.540 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-437.el9.x86_64 2024-04-26T21:24:56.540 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:24:56.540 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T21:24:56.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:24:56.680 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum upgrade -y linux-firmware 2024-04-26T21:24:56.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum upgrade -y linux-firmware 2024-04-26T21:24:59.239 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.0 MB 00:00 2024-04-26T21:24:59.413 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-04-26T21:25:01.123 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-26T21:25:01.439 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T21:25:05.540 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T21:25:05.832 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.2 MB 00:00 2024-04-26T21:25:07.549 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 16 kB 00:00 2024-04-26T21:25:08.216 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-26T21:25:09.075 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-26T21:25:09.611 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-26T21:25:14.094 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-26T21:25:14.825 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-26T21:25:16.033 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-26T21:25:16.034 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-26T21:25:16.034 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-26T21:25:16.136 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T21:25:16.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:25:16.275 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T21:25:16.275 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T21:25:16.278 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi112.front.sepia.ceph.com to complete... 2024-04-26T21:25:16.883 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-26T21:25:16.884 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-26T21:25:16.884 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-26T21:25:16.992 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T21:25:16.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:25:17.212 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T21:25:17.212 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T21:25:17.215 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2024-04-26T21:25:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26 21:25:29 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T21:25:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:FINISHED --2024-04-26 21:25:29-- 2024-04-26T21:25:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:Total wall clock time: 14s 2024-04-26T21:25:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:Downloaded: 1 files, 341M in 13s (25.4 MB/s) 2024-04-26T21:25:29.985 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T21:25:29.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T21:25:32.111 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying... ######################################## 2024-04-26T21:25:32.355 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing... ######################################## 2024-04-26T21:25:32.453 INFO:teuthology.orchestra.run.smithi112.stdout:Updating / installing... 2024-04-26T21:25:40.397 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T21:25:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26 21:25:41 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T21:25:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2024-04-26 21:25:41-- 2024-04-26T21:25:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 24s 2024-04-26T21:25:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 341M in 24s (14.5 MB/s) 2024-04-26T21:25:41.214 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T21:25:41.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T21:25:43.405 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying... ######################################## 2024-04-26T21:25:43.533 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing... ######################################## 2024-04-26T21:25:43.638 INFO:teuthology.orchestra.run.smithi005.stdout:Updating / installing... 2024-04-26T21:25:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T21:26:19.218 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T21:26:19.218 DEBUG:teuthology.orchestra.run.smithi112:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T21:26:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T21:26:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T21:26:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T21:26:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T21:26:19.305 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T21:26:19.306 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T21:26:19.307 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T21:26:19.308 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T21:26:19.309 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T21:26:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T21:26:19.311 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T21:26:19.312 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T21:26:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T21:26:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T21:26:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T21:26:19.316 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T21:26:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T21:26:19.318 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T21:26:19.319 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T21:26:19.320 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T21:26:19.321 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T21:26:19.322 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T21:26:19.323 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T21:26:19.324 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T21:26:19.325 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T21:26:19.326 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T21:26:19.327 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T21:26:19.328 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T21:26:19.329 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T21:26:19.330 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T21:26:19.331 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T21:26:19.332 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T21:26:19.333 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T21:26:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T21:26:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T21:26:19.336 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T21:26:19.337 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T21:26:19.338 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T21:26:19.339 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T21:26:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T21:26:19.341 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T21:26:19.342 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T21:26:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T21:26:19.344 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T21:26:19.345 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T21:26:19.346 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T21:26:19.347 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T21:26:19.348 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T21:26:19.349 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T21:26:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T21:26:19.351 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T21:26:19.352 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T21:26:19.353 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T21:26:19.354 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T21:26:19.355 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T21:26:19.356 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T21:26:19.357 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T21:26:19.358 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T21:26:19.359 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T21:26:19.360 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T21:26:19.361 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T21:26:19.362 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T21:26:19.363 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T21:26:19.364 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T21:26:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T21:26:19.366 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T21:26:19.367 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T21:26:19.368 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T21:26:19.369 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T21:26:19.370 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T21:26:19.371 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T21:26:19.372 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T21:26:19.373 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T21:26:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T21:26:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T21:26:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T21:26:19.377 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T21:26:19.378 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T21:26:19.379 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T21:26:19.380 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T21:26:19.381 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T21:26:19.382 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T21:26:19.383 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T21:26:19.384 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T21:26:19.385 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T21:26:19.386 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T21:26:19.387 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T21:26:19.388 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T21:26:19.389 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T21:26:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T21:26:19.391 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T21:26:19.392 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T21:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T21:26:19.394 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T21:26:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T21:26:19.396 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T21:26:19.397 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T21:26:19.398 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T21:26:19.399 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T21:26:19.400 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T21:26:19.401 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T21:26:19.402 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T21:26:19.403 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T21:26:19.404 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T21:26:19.405 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T21:26:19.406 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T21:26:19.407 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T21:26:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T21:26:19.409 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T21:26:19.410 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T21:26:19.411 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T21:26:19.412 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T21:26:19.413 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T21:26:19.414 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T21:26:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T21:26:19.416 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T21:26:19.417 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T21:26:19.418 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T21:26:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T21:26:19.420 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T21:26:19.421 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T21:26:19.422 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T21:26:19.423 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T21:26:19.424 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T21:26:19.425 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T21:26:19.426 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T21:26:19.427 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T21:26:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T21:26:19.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T21:26:19.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T21:26:19.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T21:26:19.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T21:26:19.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T21:26:19.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T21:26:19.429 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T21:26:19.430 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T21:26:19.431 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T21:26:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T21:26:19.433 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T21:26:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T21:26:19.435 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T21:26:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T21:26:19.437 INFO:teuthology.orchestra.run.smithi112.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:26:19.442 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:19.442 DEBUG:teuthology.orchestra.run.smithi112:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout:for file in vmlinuz System.map config; do 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout: fi 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:26:19.464 INFO:teuthology.orchestra.run.smithi112.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:19.465 INFO:teuthology.orchestra.run.smithi112.stdout:fi 2024-04-26T21:26:19.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.06 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 68.el9 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Group : Unspecified 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 8264254 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T21:26:19.541 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : builder@centos.org 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-04-26T21:26:19.542 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:26:19.543 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T21:26:19.543 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T21:26:19.544 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:19.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T21:26:20.128 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-04-26T21:26:21.482 INFO:teuthology.orchestra.run.smithi112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T21:26:21.512 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-04-26T21:26:21.514 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-26T21:26:21.528 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.KKgIAx0pJ5 2024-04-26T21:26:21.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KKgIAx0pJ5 2024-04-26T21:26:21.593 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.KKgIAx0pJ5 2024-04-26T21:26:21.730 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.KKgIAx0pJ5 is 6KB 2024-04-26T21:26:21.778 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.KKgIAx0pJ5 2024-04-26T21:26:21.793 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T21:26:21.864 INFO:teuthology.orchestra.run.smithi112.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T21:26:21.864 INFO:teuthology.orchestra.run.smithi112.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T21:26:21.864 INFO:teuthology.orchestra.run.smithi112.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T21:26:21.864 INFO:teuthology.orchestra.run.smithi112.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T21:26:21.866 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:22.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-04-26T21:26:30.126 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T21:26:30.126 DEBUG:teuthology.orchestra.run.smithi005:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T21:26:30.206 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:30.206 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:30.206 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:30.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T21:26:30.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T21:26:30.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T21:26:30.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T21:26:30.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T21:26:30.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T21:26:30.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T21:26:30.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T21:26:30.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T21:26:30.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T21:26:30.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T21:26:30.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T21:26:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T21:26:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T21:26:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T21:26:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T21:26:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T21:26:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T21:26:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T21:26:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T21:26:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T21:26:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T21:26:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T21:26:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T21:26:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T21:26:30.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T21:26:30.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T21:26:30.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T21:26:30.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T21:26:30.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T21:26:30.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T21:26:30.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T21:26:30.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T21:26:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T21:26:30.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T21:26:30.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T21:26:30.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T21:26:30.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T21:26:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T21:26:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T21:26:30.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T21:26:30.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T21:26:30.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T21:26:30.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T21:26:30.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T21:26:30.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T21:26:30.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T21:26:30.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T21:26:30.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T21:26:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T21:26:30.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T21:26:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T21:26:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T21:26:30.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T21:26:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T21:26:30.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T21:26:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T21:26:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T21:26:30.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T21:26:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T21:26:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T21:26:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T21:26:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T21:26:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T21:26:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T21:26:30.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T21:26:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T21:26:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T21:26:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T21:26:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T21:26:30.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T21:26:30.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T21:26:30.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T21:26:30.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T21:26:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T21:26:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T21:26:30.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T21:26:30.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T21:26:30.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T21:26:30.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T21:26:30.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T21:26:30.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T21:26:30.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T21:26:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T21:26:30.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T21:26:30.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T21:26:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T21:26:30.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T21:26:30.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T21:26:30.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T21:26:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T21:26:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T21:26:30.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T21:26:30.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T21:26:30.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T21:26:30.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T21:26:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T21:26:30.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T21:26:30.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T21:26:30.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T21:26:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T21:26:30.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T21:26:30.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T21:26:30.297 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T21:26:30.298 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T21:26:30.299 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T21:26:30.300 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T21:26:30.301 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T21:26:30.302 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T21:26:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T21:26:30.304 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T21:26:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T21:26:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T21:26:30.307 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T21:26:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T21:26:30.309 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T21:26:30.310 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T21:26:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T21:26:30.312 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T21:26:30.313 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T21:26:30.314 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T21:26:30.315 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T21:26:30.316 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T21:26:30.317 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T21:26:30.318 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T21:26:30.319 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T21:26:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T21:26:30.321 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T21:26:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T21:26:30.323 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T21:26:30.324 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T21:26:30.325 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T21:26:30.326 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T21:26:30.327 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T21:26:30.328 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T21:26:30.329 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T21:26:30.330 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T21:26:30.331 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T21:26:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T21:26:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T21:26:30.334 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T21:26:30.335 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T21:26:30.336 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T21:26:30.337 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T21:26:30.338 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T21:26:30.339 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T21:26:30.340 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T21:26:30.341 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T21:26:30.342 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T21:26:30.343 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T21:26:30.344 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T21:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T21:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T21:26:30.347 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T21:26:30.348 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T21:26:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T21:26:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T21:26:30.351 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T21:26:30.352 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T21:26:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T21:26:30.354 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T21:26:30.355 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:26:30.358 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:30.359 DEBUG:teuthology.orchestra.run.smithi005:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:for file in vmlinuz System.map config; do 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: fi 2024-04-26T21:26:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:done 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:30.386 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-04-26T21:26:30.387 INFO:teuthology.orchestra.run.smithi005.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T21:26:30.387 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T21:26:30.387 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:30.387 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-04-26T21:26:30.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 68.el9 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8264254 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T21:26:30.465 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T21:26:30.466 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T21:26:30.470 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T21:26:30.470 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-04-26T21:26:30.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:26:30.470 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T21:26:30.472 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T21:26:30.472 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:30.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T21:26:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-04-26T21:26:32.428 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T21:26:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-04-26T21:26:32.477 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-04-26T21:26:32.515 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.wAZ4gRA3Fr 2024-04-26T21:26:32.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wAZ4gRA3Fr 2024-04-26T21:26:32.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.wAZ4gRA3Fr 2024-04-26T21:26:32.720 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.wAZ4gRA3Fr is 6KB 2024-04-26T21:26:32.769 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.wAZ4gRA3Fr 2024-04-26T21:26:32.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T21:26:32.846 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T21:26:32.846 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T21:26:32.846 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T21:26:32.846 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T21:26:32.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T21:26:33.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-04-26T21:26:52.033 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T21:26:52.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:26:52.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:27:03.036 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T21:27:03.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-26T21:27:03.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:27:10.366 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T21:27:19.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:27:19.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:27:21.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-04-26T21:27:22.430 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T21:27:30.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-26T21:27:30.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:27:33.442 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-04-26T21:27:34.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:27:34.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:27:45.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-26T21:27:45.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:27:52.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T21:28:07.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:28:07.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:28:08.468 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-26T21:28:08.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:28:08.982 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T21:28:08.983 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-04-26T21:28:09.025 INFO:teuthology.orchestra.run.smithi112.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T21:28:09.026 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T21:28:09.026 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T21:28:09.026 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T21:28:10.026 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T21:28:10.027 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T21:28:10.132 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-04-26T21:28:10.185 DEBUG:teuthology.parallel:result is None 2024-04-26T21:28:17.539 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-04-26T21:28:18.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-26T21:28:18.097 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T21:28:18.097 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-04-26T21:28:18.142 INFO:teuthology.orchestra.run.smithi005.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T21:28:18.142 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T21:28:18.142 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T21:28:18.142 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T21:28:19.143 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T21:28:19.143 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T21:28:19.263 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-04-26T21:28:19.309 DEBUG:teuthology.parallel:result is None 2024-04-26T21:28:19.310 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T21:28:19.321 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T21:28:19.321 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:28:19.328 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:28:19.383 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T21:28:19.389 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T21:28:19.397 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T21:28:19.398 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:28:19.416 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:28:19.477 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T21:28:19.485 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T21:28:19.485 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:28:19.489 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:28:19.568 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:28:19.587 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:28:19.597 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:28:19.618 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:28:19.623 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T21:28:19.631 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T21:28:19.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:28:19.635 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:28:19.710 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T21:28:19.719 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T21:28:19.719 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:28:19.723 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:28:19.770 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:28:19.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:28:19.959 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:28:20.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:28:20.128 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:28:20.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:28:20.203 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:28:20.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:28:20.366 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:28:20.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:28:20.507 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:28:20.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:28:20.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-04-26T21:28:20.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-04-26T21:28:20.675 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:28:20.775 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:28:21.228 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T21:28:21.236 INFO:teuthology.task.internal:Starting timer... 2024-04-26T21:28:21.237 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T21:28:21.252 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T21:28:21.271 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T21:28:21.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-04-26T21:28:21.404 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-04-26T21:28:21.409 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-04-26T21:28:21.584 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-04-26T21:28:21.594 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T21:28:21.594 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-04-26T21:28:21.652 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-04-26T21:28:21.652 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-04-26T21:28:21.746 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-04-26T21:28:21.746 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2024-04-26T21:28:21.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:28:21.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:28:21.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:28:21.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:28:21.960 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T21:28:21.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-04-26T21:28:22.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-04-26T21:28:22.184 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T21:28:22.692 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T21:28:22.699 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T21:28:22.847 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T21:28:22.865 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T21:28:22.866 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T21:33:34.354 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-04-26T21:33:34.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-26T21:33:34.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:33:34.477 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-04-26T21:33:34.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-26T21:33:34.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:33:34.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:33:34.743 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-26T21:33:34.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:33:34.903 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T21:33:34.913 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T21:33:34.914 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:33:34.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:33:34.922 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:33:34.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:33:35.002 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T21:33:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T21:33:35.043 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T21:33:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T21:33:35.116 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-04-26T21:33:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-04-26T21:33:35.146 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-04-26T21:33:35.168 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-04-26T21:33:35.186 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T21:33:35.212 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T21:33:35.226 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T21:33:35.256 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T21:33:35.352 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:33:35.361 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:33:35.361 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-26T21:33:35.361 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.361 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.361 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.361 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:33:35.411 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:33:35.411 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-26T21:33:35.411 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.411 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.411 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.411 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:33:35.413 INFO:teuthology.run_tasks:Running task install... 2024-04-26T21:33:35.423 DEBUG:teuthology.task.install:project ceph 2024-04-26T21:33:35.423 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T21:33:35.423 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T21:33:35.424 INFO:teuthology.task.install:Using flavor: default 2024-04-26T21:33:35.431 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T21:33:35.431 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T21:33:35.431 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T21:33:35.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:33:35.434 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T21:33:35.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:33:35.658 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T21:33:35.658 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T21:33:35.663 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T21:33:35.663 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T21:33:35.768 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T21:33:35.768 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:33:35.768 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T21:33:35.777 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T21:33:35.777 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:33:35.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T21:33:35.858 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T21:33:35.859 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T21:33:35.873 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T21:33:35.873 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T21:33:35.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T21:33:36.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T21:33:36.097 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T21:33:36.120 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T21:33:36.171 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-04-26T21:33:36.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-04-26T21:33:36.204 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-04-26T21:33:36.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-04-26T21:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout:48 files removed 2024-04-26T21:33:36.540 INFO:teuthology.orchestra.run.smithi005.stdout:48 files removed 2024-04-26T21:33:36.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T21:33:36.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T21:33:37.409 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 221 kB/s | 84 kB 00:00 2024-04-26T21:33:37.546 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 147 kB/s | 84 kB 00:00 2024-04-26T21:33:38.001 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-04-26T21:33:38.180 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 22 kB/s | 12 kB 00:00 2024-04-26T21:33:38.468 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-26T21:33:38.822 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-04-26T21:33:39.383 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.0 MB 00:00 2024-04-26T21:33:39.579 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T21:33:42.430 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-26T21:33:43.643 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:03 2024-04-26T21:33:47.614 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.2 MB 00:01 2024-04-26T21:33:48.968 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.2 MB 00:01 2024-04-26T21:33:49.257 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-04-26T21:33:51.011 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-26T21:33:51.214 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-26T21:33:53.026 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-26T21:33:57.083 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-26T21:33:59.195 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-26T21:33:59.499 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:33:59.501 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:33:59.520 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T21:33:59.522 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T21:33:59.523 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T21:33:59.524 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T21:33:59.527 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T21:33:59.530 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T21:33:59.534 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T21:33:59.601 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T21:33:59.619 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T21:33:59.620 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T21:33:59.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T21:33:59.622 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T21:33:59.623 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T21:33:59.624 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T21:33:59.625 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T21:33:59.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T21:33:59.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T21:33:59.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T21:33:59.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T21:33:59.630 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout:Install 148 Packages 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 4 Packages 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:33:59.631 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 222 M 2024-04-26T21:33:59.632 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-26T21:34:00.818 INFO:teuthology.orchestra.run.smithi112.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-26T21:34:01.318 INFO:teuthology.orchestra.run.smithi112.stdout:(2/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 6.5 MB/s | 5.4 MB 00:00 2024-04-26T21:34:01.402 INFO:teuthology.orchestra.run.smithi112.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.7 MB/s | 145 kB 00:00 2024-04-26T21:34:01.652 INFO:teuthology.orchestra.run.smithi112.stdout:(4/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.0 MB/s | 889 kB 00:00 2024-04-26T21:34:01.688 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:34:01.690 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:34:01.711 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T21:34:01.712 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T21:34:01.714 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T21:34:01.715 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T21:34:01.717 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T21:34:01.721 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T21:34:01.722 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T21:34:01.727 INFO:teuthology.orchestra.run.smithi112.stdout:(5/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 7.3 MB/s | 2.4 MB 00:00 2024-04-26T21:34:01.798 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T21:34:01.828 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T21:34:01.829 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T21:34:01.830 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T21:34:01.831 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T21:34:01.832 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T21:34:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T21:34:01.834 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T21:34:01.835 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T21:34:01.836 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T21:34:01.837 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T21:34:01.838 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout:Install 148 Packages 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 4 Packages 2024-04-26T21:34:01.839 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:34:01.840 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 222 M 2024-04-26T21:34:01.840 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-26T21:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout:(6/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 12 MB/s | 21 MB 00:01 2024-04-26T21:34:02.403 INFO:teuthology.orchestra.run.smithi112.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 7.0 MB/s | 4.7 MB 00:00 2024-04-26T21:34:02.470 INFO:teuthology.orchestra.run.smithi112.stdout:(8/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 1.9 MB/s | 1.5 MB 00:00 2024-04-26T21:34:02.570 INFO:teuthology.orchestra.run.smithi112.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 254 kB/s | 25 kB 00:00 2024-04-26T21:34:03.447 INFO:teuthology.orchestra.run.smithi005.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-26T21:34:03.479 INFO:teuthology.orchestra.run.smithi112.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 9.9 MB/s | 11 MB 00:01 2024-04-26T21:34:03.721 INFO:teuthology.orchestra.run.smithi112.stdout:(11/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 12 MB/s | 17 MB 00:01 2024-04-26T21:34:03.754 INFO:teuthology.orchestra.run.smithi112.stdout:(12/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 819 kB/s | 225 kB 00:00 2024-04-26T21:34:03.796 INFO:teuthology.orchestra.run.smithi112.stdout:(13/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 364 kB/s | 27 kB 00:00 2024-04-26T21:34:03.838 INFO:teuthology.orchestra.run.smithi112.stdout:(14/152): libcephfs-devel-19.0.0-3306.gbc612ffb 383 kB/s | 32 kB 00:00 2024-04-26T21:34:03.972 INFO:teuthology.orchestra.run.smithi112.stdout:(15/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 4.2 MB/s | 747 kB 00:00 2024-04-26T21:34:04.055 INFO:teuthology.orchestra.run.smithi112.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 1.5 MB/s | 127 kB 00:00 2024-04-26T21:34:04.156 INFO:teuthology.orchestra.run.smithi112.stdout:(17/152): libradosstriper1-19.0.0-3306.gbc612ff 4.9 MB/s | 501 kB 00:00 2024-04-26T21:34:04.306 INFO:teuthology.orchestra.run.smithi112.stdout:(18/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 350 kB/s | 163 kB 00:00 2024-04-26T21:34:04.378 INFO:teuthology.orchestra.run.smithi005.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 956 kB/s | 889 kB 00:00 2024-04-26T21:34:04.398 INFO:teuthology.orchestra.run.smithi112.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 495 kB/s | 45 kB 00:00 2024-04-26T21:34:04.498 INFO:teuthology.orchestra.run.smithi112.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 1.3 MB/s | 135 kB 00:00 2024-04-26T21:34:04.564 INFO:teuthology.orchestra.run.smithi005.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 789 kB/s | 145 kB 00:00 2024-04-26T21:34:04.590 INFO:teuthology.orchestra.run.smithi112.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 1.7 MB/s | 161 kB 00:00 2024-04-26T21:34:04.777 INFO:teuthology.orchestra.run.smithi112.stdout:(22/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 8.7 MB/s | 5.4 MB 00:00 2024-04-26T21:34:04.815 INFO:teuthology.orchestra.run.smithi112.stdout:(23/152): python3-rados-19.0.0-3306.gbc612ffb.e 1.4 MB/s | 321 kB 00:00 2024-04-26T21:34:04.857 INFO:teuthology.orchestra.run.smithi112.stdout:(24/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 3.7 MB/s | 298 kB 00:00 2024-04-26T21:34:04.891 INFO:teuthology.orchestra.run.smithi112.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.3 MB/s | 99 kB 00:00 2024-04-26T21:34:04.916 INFO:teuthology.orchestra.run.smithi112.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-26T21:34:04.975 INFO:teuthology.orchestra.run.smithi112.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.9 MB/s | 171 kB 00:00 2024-04-26T21:34:05.042 INFO:teuthology.orchestra.run.smithi112.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 520 kB/s | 34 kB 00:00 2024-04-26T21:34:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:(4/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 10 MB/s | 21 MB 00:02 2024-04-26T21:34:05.117 INFO:teuthology.orchestra.run.smithi112.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.9 MB/s | 142 kB 00:00 2024-04-26T21:34:05.192 INFO:teuthology.orchestra.run.smithi112.stdout:(30/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 10 MB/s | 3.1 MB 00:00 2024-04-26T21:34:05.306 INFO:teuthology.orchestra.run.smithi005.stdout:(5/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 7.4 MB/s | 1.5 MB 00:00 2024-04-26T21:34:05.568 INFO:teuthology.orchestra.run.smithi112.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 7.9 MB/s | 3.5 MB 00:00 2024-04-26T21:34:05.660 INFO:teuthology.orchestra.run.smithi112.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 2.7 MB/s | 249 kB 00:00 2024-04-26T21:34:05.714 INFO:teuthology.orchestra.run.smithi005.stdout:(6/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-04-26T21:34:05.718 INFO:teuthology.orchestra.run.smithi112.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 859 kB/s | 49 kB 00:00 2024-04-26T21:34:05.794 INFO:teuthology.orchestra.run.smithi112.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 222 kB/s | 16 kB 00:00 2024-04-26T21:34:05.902 INFO:teuthology.orchestra.run.smithi112.stdout:(35/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 2.5 MB/s | 273 kB 00:00 2024-04-26T21:34:06.015 INFO:teuthology.orchestra.run.smithi005.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 6.6 MB/s | 4.7 MB 00:00 2024-04-26T21:34:06.044 INFO:teuthology.orchestra.run.smithi112.stdout:(36/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 5.3 MB/s | 762 kB 00:00 2024-04-26T21:34:06.111 INFO:teuthology.orchestra.run.smithi112.stdout:(37/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 277 kB/s | 18 kB 00:00 2024-04-26T21:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout:(38/152): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-04-26T21:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 357 kB/s | 80 kB 00:00 2024-04-26T21:34:06.365 INFO:teuthology.orchestra.run.smithi005.stdout:(8/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-04-26T21:34:06.449 INFO:teuthology.orchestra.run.smithi005.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 306 kB/s | 25 kB 00:00 2024-04-26T21:34:06.495 INFO:teuthology.orchestra.run.smithi112.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-26T21:34:06.587 INFO:teuthology.orchestra.run.smithi112.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-26T21:34:06.638 INFO:teuthology.orchestra.run.smithi112.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-04-26T21:34:06.704 INFO:teuthology.orchestra.run.smithi112.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T21:34:06.755 INFO:teuthology.orchestra.run.smithi112.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 7.4 MB/s | 1.2 MB 00:00 2024-04-26T21:34:06.788 INFO:teuthology.orchestra.run.smithi112.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-04-26T21:34:06.830 INFO:teuthology.orchestra.run.smithi112.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-26T21:34:06.864 INFO:teuthology.orchestra.run.smithi112.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-04-26T21:34:07.039 INFO:teuthology.orchestra.run.smithi112.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-04-26T21:34:07.115 INFO:teuthology.orchestra.run.smithi112.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-04-26T21:34:07.148 INFO:teuthology.orchestra.run.smithi112.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 992 kB/s | 107 kB 00:00 2024-04-26T21:34:07.149 INFO:teuthology.orchestra.run.smithi005.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 9.3 MB/s | 11 MB 00:01 2024-04-26T21:34:07.173 INFO:teuthology.orchestra.run.smithi112.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 372 kB/s | 21 kB 00:00 2024-04-26T21:34:07.207 INFO:teuthology.orchestra.run.smithi112.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-04-26T21:34:07.216 INFO:teuthology.orchestra.run.smithi005.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 3.4 MB/s | 225 kB 00:00 2024-04-26T21:34:07.233 INFO:teuthology.orchestra.run.smithi112.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 566 kB/s | 33 kB 00:00 2024-04-26T21:34:07.291 INFO:teuthology.orchestra.run.smithi005.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 364 kB/s | 27 kB 00:00 2024-04-26T21:34:07.291 INFO:teuthology.orchestra.run.smithi112.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 317 kB/s | 18 kB 00:00 2024-04-26T21:34:07.342 INFO:teuthology.orchestra.run.smithi112.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 226 kB/s | 11 kB 00:00 2024-04-26T21:34:07.358 INFO:teuthology.orchestra.run.smithi005.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 482 kB/s | 32 kB 00:00 2024-04-26T21:34:07.433 INFO:teuthology.orchestra.run.smithi112.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-26T21:34:07.467 INFO:teuthology.orchestra.run.smithi112.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-04-26T21:34:07.491 INFO:teuthology.orchestra.run.smithi005.stdout:(14/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 5.5 MB/s | 747 kB 00:00 2024-04-26T21:34:07.492 INFO:teuthology.orchestra.run.smithi112.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 785 kB/s | 45 kB 00:00 2024-04-26T21:34:07.551 INFO:teuthology.orchestra.run.smithi112.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-26T21:34:07.558 INFO:teuthology.orchestra.run.smithi005.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.4 MB/s | 163 kB 00:00 2024-04-26T21:34:07.593 INFO:teuthology.orchestra.run.smithi112.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-04-26T21:34:07.618 INFO:teuthology.orchestra.run.smithi112.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 385 kB/s | 25 kB 00:00 2024-04-26T21:34:07.643 INFO:teuthology.orchestra.run.smithi112.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 959 kB/s | 47 kB 00:00 2024-04-26T21:34:07.654 INFO:teuthology.orchestra.run.smithi005.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 1.3 MB/s | 127 kB 00:00 2024-04-26T21:34:07.677 INFO:teuthology.orchestra.run.smithi112.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.0 MB/s | 292 kB 00:00 2024-04-26T21:34:07.711 INFO:teuthology.orchestra.run.smithi112.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-26T21:34:07.727 INFO:teuthology.orchestra.run.smithi112.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 713 kB/s | 35 kB 00:00 2024-04-26T21:34:07.884 INFO:teuthology.orchestra.run.smithi005.stdout:(17/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 7.8 MB/s | 17 MB 00:02 2024-04-26T21:34:07.895 INFO:teuthology.orchestra.run.smithi112.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-26T21:34:07.934 INFO:teuthology.orchestra.run.smithi005.stdout:(18/152): libradosstriper1-19.0.0-3306.gbc612ff 1.8 MB/s | 501 kB 00:00 2024-04-26T21:34:07.987 INFO:teuthology.orchestra.run.smithi112.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-26T21:34:08.016 INFO:teuthology.orchestra.run.smithi005.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 557 kB/s | 45 kB 00:00 2024-04-26T21:34:08.085 INFO:teuthology.orchestra.run.smithi005.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 2.0 MB/s | 135 kB 00:00 2024-04-26T21:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-26T21:34:08.168 INFO:teuthology.orchestra.run.smithi005.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 1.9 MB/s | 161 kB 00:00 2024-04-26T21:34:08.171 INFO:teuthology.orchestra.run.smithi112.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 4.9 MB/s | 911 kB 00:00 2024-04-26T21:34:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-26T21:34:08.302 INFO:teuthology.orchestra.run.smithi005.stdout:(22/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 13 MB/s | 5.4 MB 00:00 2024-04-26T21:34:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-26T21:34:08.335 INFO:teuthology.orchestra.run.smithi005.stdout:(23/152): python3-rados-19.0.0-3306.gbc612ffb.e 1.9 MB/s | 321 kB 00:00 2024-04-26T21:34:08.402 INFO:teuthology.orchestra.run.smithi005.stdout:(24/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 2.9 MB/s | 298 kB 00:00 2024-04-26T21:34:08.413 INFO:teuthology.orchestra.run.smithi112.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-04-26T21:34:08.436 INFO:teuthology.orchestra.run.smithi005.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 998 kB/s | 99 kB 00:00 2024-04-26T21:34:08.438 INFO:teuthology.orchestra.run.smithi112.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 658 kB/s | 87 kB 00:00 2024-04-26T21:34:08.478 INFO:teuthology.orchestra.run.smithi005.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-26T21:34:08.514 INFO:teuthology.orchestra.run.smithi112.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-26T21:34:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-26T21:34:08.564 INFO:teuthology.orchestra.run.smithi112.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-26T21:34:08.620 INFO:teuthology.orchestra.run.smithi005.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 596 kB/s | 34 kB 00:00 2024-04-26T21:34:08.673 INFO:teuthology.orchestra.run.smithi112.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-04-26T21:34:08.698 INFO:teuthology.orchestra.run.smithi112.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 193 kB/s | 26 kB 00:00 2024-04-26T21:34:08.720 INFO:teuthology.orchestra.run.smithi005.stdout:(29/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 11 MB/s | 3.1 MB 00:00 2024-04-26T21:34:08.723 INFO:teuthology.orchestra.run.smithi112.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 389 kB/s | 19 kB 00:00 2024-04-26T21:34:08.757 INFO:teuthology.orchestra.run.smithi112.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-26T21:34:08.774 INFO:teuthology.orchestra.run.smithi005.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 928 kB/s | 142 kB 00:00 2024-04-26T21:34:08.782 INFO:teuthology.orchestra.run.smithi112.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 602 kB/s | 35 kB 00:00 2024-04-26T21:34:08.841 INFO:teuthology.orchestra.run.smithi112.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-04-26T21:34:08.900 INFO:teuthology.orchestra.run.smithi112.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-04-26T21:34:08.958 INFO:teuthology.orchestra.run.smithi112.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-26T21:34:09.058 INFO:teuthology.orchestra.run.smithi112.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-04-26T21:34:09.084 INFO:teuthology.orchestra.run.smithi112.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 339 kB/s | 42 kB 00:00 2024-04-26T21:34:09.117 INFO:teuthology.orchestra.run.smithi112.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 269 kB 00:00 2024-04-26T21:34:09.154 INFO:teuthology.orchestra.run.smithi112.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-26T21:34:09.184 INFO:teuthology.orchestra.run.smithi112.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-26T21:34:09.210 INFO:teuthology.orchestra.run.smithi112.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 882 kB/s | 51 kB 00:00 2024-04-26T21:34:09.235 INFO:teuthology.orchestra.run.smithi112.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-04-26T21:34:09.305 INFO:teuthology.orchestra.run.smithi005.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 6.1 MB/s | 3.5 MB 00:00 2024-04-26T21:34:09.310 INFO:teuthology.orchestra.run.smithi112.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 562 kB/s | 42 kB 00:00 2024-04-26T21:34:09.369 INFO:teuthology.orchestra.run.smithi112.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 768 kB/s | 44 kB 00:00 2024-04-26T21:34:09.428 INFO:teuthology.orchestra.run.smithi112.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-26T21:34:09.447 INFO:teuthology.orchestra.run.smithi005.stdout:(32/152): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-04-26T21:34:09.478 INFO:teuthology.orchestra.run.smithi112.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 731 kB/s | 36 kB 00:00 2024-04-26T21:34:09.505 INFO:teuthology.orchestra.run.smithi005.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3306.gbc 1.2 MB/s | 249 kB 00:00 2024-04-26T21:34:09.528 INFO:teuthology.orchestra.run.smithi112.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 958 kB/s | 47 kB 00:00 2024-04-26T21:34:09.530 INFO:teuthology.orchestra.run.smithi005.stdout:(34/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 598 kB/s | 49 kB 00:00 2024-04-26T21:34:09.555 INFO:teuthology.orchestra.run.smithi005.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3306.gb 334 kB/s | 16 kB 00:00 2024-04-26T21:34:09.587 INFO:teuthology.orchestra.run.smithi112.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-04-26T21:34:09.614 INFO:teuthology.orchestra.run.smithi005.stdout:(36/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 3.2 MB/s | 273 kB 00:00 2024-04-26T21:34:09.637 INFO:teuthology.orchestra.run.smithi112.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T21:34:09.673 INFO:teuthology.orchestra.run.smithi005.stdout:(37/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 6.4 MB/s | 762 kB 00:00 2024-04-26T21:34:09.688 INFO:teuthology.orchestra.run.smithi112.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-04-26T21:34:09.698 INFO:teuthology.orchestra.run.smithi005.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 220 kB/s | 18 kB 00:00 2024-04-26T21:34:09.876 INFO:teuthology.orchestra.run.smithi005.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-04-26T21:34:09.896 INFO:teuthology.orchestra.run.smithi112.stdout:(99/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-04-26T21:34:09.921 INFO:teuthology.orchestra.run.smithi112.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 273 kB/s | 64 kB 00:00 2024-04-26T21:34:09.947 INFO:teuthology.orchestra.run.smithi112.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 912 kB/s | 45 kB 00:00 2024-04-26T21:34:10.065 INFO:teuthology.orchestra.run.smithi005.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-26T21:34:10.107 INFO:teuthology.orchestra.run.smithi005.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-04-26T21:34:10.157 INFO:teuthology.orchestra.run.smithi005.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-26T21:34:10.216 INFO:teuthology.orchestra.run.smithi005.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-26T21:34:10.283 INFO:teuthology.orchestra.run.smithi005.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-04-26T21:34:10.308 INFO:teuthology.orchestra.run.smithi005.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-04-26T21:34:10.342 INFO:teuthology.orchestra.run.smithi005.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-26T21:34:10.378 INFO:teuthology.orchestra.run.smithi005.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-04-26T21:34:10.555 INFO:teuthology.orchestra.run.smithi112.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 35 kB/s | 22 kB 00:00 2024-04-26T21:34:11.114 INFO:teuthology.orchestra.run.smithi112.stdout:(103/152): ceph-test-19.0.0-3306.gbc612ffb.el9. 5.7 MB/s | 49 MB 00:08 2024-04-26T21:34:11.156 INFO:teuthology.orchestra.run.smithi112.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 916 kB/s | 548 kB 00:00 2024-04-26T21:34:11.181 INFO:teuthology.orchestra.run.smithi112.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 798 kB/s | 19 kB 00:00 2024-04-26T21:34:11.240 INFO:teuthology.orchestra.run.smithi112.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-04-26T21:34:11.274 INFO:teuthology.orchestra.run.smithi112.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 792 kB/s | 26 kB 00:00 2024-04-26T21:34:11.324 INFO:teuthology.orchestra.run.smithi112.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 987 kB/s | 49 kB 00:00 2024-04-26T21:34:11.366 INFO:teuthology.orchestra.run.smithi112.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-04-26T21:34:11.483 INFO:teuthology.orchestra.run.smithi112.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-26T21:34:11.517 INFO:teuthology.orchestra.run.smithi112.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-26T21:34:11.575 INFO:teuthology.orchestra.run.smithi112.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 839 kB 00:00 2024-04-26T21:34:11.609 INFO:teuthology.orchestra.run.smithi112.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 5.9 MB/s | 548 kB 00:00 2024-04-26T21:34:11.634 INFO:teuthology.orchestra.run.smithi112.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 752 kB/s | 43 kB 00:00 2024-04-26T21:34:11.660 INFO:teuthology.orchestra.run.smithi112.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 651 kB/s | 32 kB 00:00 2024-04-26T21:34:11.685 INFO:teuthology.orchestra.run.smithi112.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 303 kB/s | 15 kB 00:00 2024-04-26T21:34:11.718 INFO:teuthology.orchestra.run.smithi112.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-26T21:34:11.726 INFO:teuthology.orchestra.run.smithi005.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 498 kB/s | 689 kB 00:01 2024-04-26T21:34:11.752 INFO:teuthology.orchestra.run.smithi112.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-04-26T21:34:11.786 INFO:teuthology.orchestra.run.smithi112.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-04-26T21:34:11.802 INFO:teuthology.orchestra.run.smithi112.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 709 kB/s | 35 kB 00:00 2024-04-26T21:34:11.836 INFO:teuthology.orchestra.run.smithi112.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 4.1 MB/s | 206 kB 00:00 2024-04-26T21:34:11.887 INFO:teuthology.orchestra.run.smithi112.stdout:(122/152): protobuf-compiler-3.14.0-13.el9.x86_ 445 kB/s | 863 kB 00:01 2024-04-26T21:34:11.920 INFO:teuthology.orchestra.run.smithi112.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-26T21:34:11.946 INFO:teuthology.orchestra.run.smithi112.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 186 kB/s | 11 kB 00:00 2024-04-26T21:34:11.963 INFO:teuthology.orchestra.run.smithi112.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 429 kB/s | 18 kB 00:00 2024-04-26T21:34:11.979 INFO:teuthology.orchestra.run.smithi112.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 705 kB/s | 23 kB 00:00 2024-04-26T21:34:11.996 INFO:teuthology.orchestra.run.smithi112.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 593 kB/s | 19 kB 00:00 2024-04-26T21:34:12.013 INFO:teuthology.orchestra.run.smithi112.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 600 kB/s | 20 kB 00:00 2024-04-26T21:34:12.039 INFO:teuthology.orchestra.run.smithi112.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 1.9 MB/s | 46 kB 00:00 2024-04-26T21:34:12.097 INFO:teuthology.orchestra.run.smithi112.stdout:(130/152): python3-grpcio-1.46.7-10.el9.x86_64. 6.9 MB/s | 2.0 MB 00:00 2024-04-26T21:34:12.122 INFO:teuthology.orchestra.run.smithi112.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 951 kB/s | 79 kB 00:00 2024-04-26T21:34:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 539 kB/s | 943 kB 00:01 2024-04-26T21:34:12.139 INFO:teuthology.orchestra.run.smithi112.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-26T21:34:12.190 INFO:teuthology.orchestra.run.smithi112.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-04-26T21:34:12.207 INFO:teuthology.orchestra.run.smithi112.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2024-04-26T21:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-04-26T21:34:12.291 INFO:teuthology.orchestra.run.smithi112.stdout:(136/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-04-26T21:34:12.307 INFO:teuthology.orchestra.run.smithi112.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 283 kB/s | 28 kB 00:00 2024-04-26T21:34:12.324 INFO:teuthology.orchestra.run.smithi112.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 336 kB/s | 31 kB 00:00 2024-04-26T21:34:12.341 INFO:teuthology.orchestra.run.smithi112.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-04-26T21:34:12.358 INFO:teuthology.orchestra.run.smithi112.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-04-26T21:34:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-26T21:34:12.400 INFO:teuthology.orchestra.run.smithi112.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 880 kB/s | 51 kB 00:00 2024-04-26T21:34:12.434 INFO:teuthology.orchestra.run.smithi112.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T21:34:12.459 INFO:teuthology.orchestra.run.smithi112.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-26T21:34:12.476 INFO:teuthology.orchestra.run.smithi112.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 487 kB/s | 20 kB 00:00 2024-04-26T21:34:12.510 INFO:teuthology.orchestra.run.smithi112.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2024-04-26T21:34:12.518 INFO:teuthology.orchestra.run.smithi005.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 135 kB/s | 107 kB 00:00 2024-04-26T21:34:12.543 INFO:teuthology.orchestra.run.smithi112.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-04-26T21:34:12.610 INFO:teuthology.orchestra.run.smithi112.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-26T21:34:12.702 INFO:teuthology.orchestra.run.smithi005.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 37 kB/s | 21 kB 00:00 2024-04-26T21:34:12.877 INFO:teuthology.orchestra.run.smithi112.stdout:(149/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 9.4 MB/s | 3.1 MB 00:00 2024-04-26T21:34:12.936 INFO:teuthology.orchestra.run.smithi112.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 4.2 MB/s | 1.3 MB 00:00 2024-04-26T21:34:13.136 INFO:teuthology.orchestra.run.smithi112.stdout:(151/152): librados2-19.0.0-3306.gbc612ffb.el9. 5.4 MB/s | 3.4 MB 00:00 2024-04-26T21:34:13.344 INFO:teuthology.orchestra.run.smithi005.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 51 kB/s | 33 kB 00:00 2024-04-26T21:34:13.353 INFO:teuthology.orchestra.run.smithi112.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.0 MB/s | 2.4 MB 00:00 2024-04-26T21:34:13.360 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:34:13.361 INFO:teuthology.orchestra.run.smithi112.stdout:Total 16 MB/s | 222 MB 00:13 2024-04-26T21:34:13.535 INFO:teuthology.orchestra.run.smithi005.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 309 kB/s | 313 kB 00:01 2024-04-26T21:34:14.094 INFO:teuthology.orchestra.run.smithi005.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 18 kB 00:00 2024-04-26T21:34:14.619 INFO:teuthology.orchestra.run.smithi005.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-04-26T21:34:15.336 INFO:teuthology.orchestra.run.smithi005.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 224 kB/s | 160 kB 00:00 2024-04-26T21:34:15.970 INFO:teuthology.orchestra.run.smithi005.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-04-26T21:34:16.298 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-26T21:34:16.540 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-26T21:34:16.540 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-26T21:34:17.587 INFO:teuthology.orchestra.run.smithi005.stdout:(58/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 4.4 MB/s | 49 MB 00:11 2024-04-26T21:34:17.670 INFO:teuthology.orchestra.run.smithi005.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 708 kB/s | 3.0 MB 00:04 2024-04-26T21:34:17.712 INFO:teuthology.orchestra.run.smithi005.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 381 kB/s | 662 kB 00:01 2024-04-26T21:34:18.304 INFO:teuthology.orchestra.run.smithi005.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 40 kB/s | 25 kB 00:00 2024-04-26T21:34:18.404 INFO:teuthology.orchestra.run.smithi005.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 69 kB/s | 47 kB 00:00 2024-04-26T21:34:18.871 INFO:teuthology.orchestra.run.smithi005.stdout:(63/152): libtool-2.4.6-45.el9.x86_64.rpm 454 kB/s | 582 kB 00:01 2024-04-26T21:34:19.187 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-26T21:34:19.187 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-26T21:34:19.271 INFO:teuthology.orchestra.run.smithi005.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 218 kB/s | 188 kB 00:00 2024-04-26T21:34:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:(65/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 293 kB/s | 292 kB 00:00 2024-04-26T21:34:19.472 INFO:teuthology.orchestra.run.smithi005.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 59 kB/s | 35 kB 00:00 2024-04-26T21:34:21.947 INFO:teuthology.orchestra.run.smithi005.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 693 kB/s | 1.6 MB 00:02 2024-04-26T21:34:23.489 INFO:teuthology.orchestra.run.smithi005.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 592 kB/s | 911 kB 00:01 2024-04-26T21:34:24.247 INFO:teuthology.orchestra.run.smithi005.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 176 kB/s | 133 kB 00:00 2024-04-26T21:34:24.872 INFO:teuthology.orchestra.run.smithi005.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 814 kB/s | 4.4 MB 00:05 2024-04-26T21:34:25.231 INFO:teuthology.orchestra.run.smithi005.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 814 kB/s | 4.7 MB 00:05 2024-04-26T21:34:25.691 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-26T21:34:25.794 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T21:34:25.867 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T21:34:25.906 INFO:teuthology.orchestra.run.smithi005.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 130 kB/s | 87 kB 00:00 2024-04-26T21:34:26.114 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T21:34:26.178 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T21:34:26.220 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T21:34:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T21:34:26.607 INFO:teuthology.orchestra.run.smithi005.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 596 kB/s | 1.0 MB 00:01 2024-04-26T21:34:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T21:34:26.934 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:34:27.100 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:34:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:34:27.246 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:34:27.286 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:34:27.498 INFO:teuthology.orchestra.run.smithi005.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 274 kB/s | 244 kB 00:00 2024-04-26T21:34:27.630 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T21:34:27.692 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T21:34:27.725 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:34:27.874 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:34:27.909 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:34:28.000 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:34:28.027 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:34:28.115 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:34:28.407 INFO:teuthology.orchestra.run.smithi005.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 273 kB/s | 248 kB 00:00 2024-04-26T21:34:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:34:28.468 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:34:28.655 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T21:34:28.782 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T21:34:28.820 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T21:34:28.867 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T21:34:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T21:34:28.999 INFO:teuthology.orchestra.run.smithi005.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-04-26T21:34:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T21:34:29.095 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T21:34:29.143 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T21:34:29.174 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T21:34:29.284 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T21:34:29.355 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T21:34:29.403 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T21:34:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T21:34:29.541 INFO:teuthology.orchestra.run.smithi005.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-04-26T21:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T21:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T21:34:29.659 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T21:34:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T21:34:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T21:34:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T21:34:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T21:34:30.198 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T21:34:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T21:34:30.357 INFO:teuthology.orchestra.run.smithi005.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 211 kB/s | 172 kB 00:00 2024-04-26T21:34:30.952 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T21:34:30.957 INFO:teuthology.orchestra.run.smithi005.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-04-26T21:34:31.074 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T21:34:31.120 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T21:34:31.279 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T21:34:31.329 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T21:34:31.333 INFO:teuthology.orchestra.run.smithi005.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 835 kB/s | 5.8 MB 00:07 2024-04-26T21:34:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T21:34:31.715 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T21:34:31.773 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T21:34:31.854 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T21:34:31.950 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T21:34:31.989 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T21:34:32.028 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T21:34:32.096 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T21:34:32.145 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T21:34:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T21:34:32.209 INFO:teuthology.orchestra.run.smithi005.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 288 kB/s | 250 kB 00:00 2024-04-26T21:34:32.283 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T21:34:32.480 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T21:34:32.534 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T21:34:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T21:34:32.619 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T21:34:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T21:34:32.780 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T21:34:32.825 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T21:34:32.869 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T21:34:32.902 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T21:34:33.108 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T21:34:33.158 INFO:teuthology.orchestra.run.smithi005.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 234 kB/s | 222 kB 00:00 2024-04-26T21:34:33.289 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T21:34:33.334 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T21:34:33.380 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T21:34:33.427 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T21:34:33.487 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T21:34:33.537 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T21:34:33.579 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T21:34:33.624 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T21:34:33.625 INFO:teuthology.orchestra.run.smithi005.stdout:(83/152): python3-babel-2.9.1-2.el9.noarch.rpm 791 kB/s | 6.0 MB 00:07 2024-04-26T21:34:33.674 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T21:34:33.748 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T21:34:33.786 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T21:34:33.925 INFO:teuthology.orchestra.run.smithi005.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 101 kB/s | 77 kB 00:00 2024-04-26T21:34:33.927 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T21:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T21:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T21:34:34.098 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T21:34:34.241 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T21:34:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 65 kB/s | 42 kB 00:00 2024-04-26T21:34:34.319 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T21:34:34.843 INFO:teuthology.orchestra.run.smithi005.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 294 kB/s | 269 kB 00:00 2024-04-26T21:34:35.060 INFO:teuthology.orchestra.run.smithi005.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 204 kB/s | 159 kB 00:00 2024-04-26T21:34:35.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T21:34:35.285 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T21:34:35.318 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T21:34:35.438 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T21:34:35.504 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T21:34:35.599 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T21:34:35.645 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T21:34:35.763 INFO:teuthology.orchestra.run.smithi005.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 81 kB/s | 51 kB 00:00 2024-04-26T21:34:35.812 INFO:teuthology.orchestra.run.smithi005.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 288 kB/s | 279 kB 00:00 2024-04-26T21:34:35.878 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T21:34:35.909 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T21:34:36.005 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T21:34:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 80 kB/s | 54 kB 00:00 2024-04-26T21:34:36.828 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T21:34:36.971 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T21:34:37.064 INFO:teuthology.orchestra.run.smithi005.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-04-26T21:34:37.581 INFO:teuthology.orchestra.run.smithi005.stdout:(92/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 788 kB/s | 5.1 MB 00:06 2024-04-26T21:34:37.697 INFO:teuthology.orchestra.run.smithi005.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 70 kB/s | 44 kB 00:00 2024-04-26T21:34:38.339 INFO:teuthology.orchestra.run.smithi005.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 56 kB/s | 36 kB 00:00 2024-04-26T21:34:38.473 INFO:teuthology.orchestra.run.smithi005.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 248 kB/s | 221 kB 00:00 2024-04-26T21:34:38.539 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T21:34:38.649 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T21:34:38.699 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T21:34:38.744 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T21:34:39.065 INFO:teuthology.orchestra.run.smithi005.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 65 kB/s | 47 kB 00:00 2024-04-26T21:34:39.117 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T21:34:39.161 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:34:39.281 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:34:39.322 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T21:34:39.385 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T21:34:39.482 INFO:teuthology.orchestra.run.smithi005.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 302 kB/s | 305 kB 00:01 2024-04-26T21:34:39.799 INFO:teuthology.orchestra.run.smithi005.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 79 kB/s | 58 kB 00:00 2024-04-26T21:34:39.936 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T21:34:39.964 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:34:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:34:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T21:34:40.182 INFO:teuthology.orchestra.run.smithi005.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 134 kB/s | 94 kB 00:00 2024-04-26T21:34:40.482 INFO:teuthology.orchestra.run.smithi005.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-04-26T21:34:40.641 INFO:teuthology.orchestra.run.smithi005.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 142 kB/s | 22 kB 00:00 2024-04-26T21:34:40.800 INFO:teuthology.orchestra.run.smithi005.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-04-26T21:34:40.917 INFO:teuthology.orchestra.run.smithi005.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-04-26T21:34:41.901 INFO:teuthology.orchestra.run.smithi005.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 340 kB/s | 309 kB 00:00 2024-04-26T21:34:42.017 INFO:teuthology.orchestra.run.smithi005.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 168 kB/s | 19 kB 00:00 2024-04-26T21:34:42.193 INFO:teuthology.orchestra.run.smithi005.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 394 kB/s | 548 kB 00:01 2024-04-26T21:34:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-04-26T21:34:42.418 INFO:teuthology.orchestra.run.smithi005.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 452 kB/s | 49 kB 00:00 2024-04-26T21:34:42.610 INFO:teuthology.orchestra.run.smithi005.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 353 kB/s | 67 kB 00:00 2024-04-26T21:34:42.674 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:34:42.712 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:34:42.901 INFO:teuthology.orchestra.run.smithi005.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 522 kB/s | 151 kB 00:00 2024-04-26T21:34:43.350 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:34:43.400 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:34:43.575 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:34:43.576 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T21:34:43.576 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T21:34:43.576 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:34:43.617 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:34:44.010 INFO:teuthology.orchestra.run.smithi005.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 757 kB/s | 839 kB 00:01 2024-04-26T21:34:44.777 INFO:teuthology.orchestra.run.smithi005.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 715 kB/s | 548 kB 00:00 2024-04-26T21:34:44.878 INFO:teuthology.orchestra.run.smithi005.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 437 kB/s | 43 kB 00:00 2024-04-26T21:34:44.978 INFO:teuthology.orchestra.run.smithi005.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 324 kB/s | 32 kB 00:00 2024-04-26T21:34:45.078 INFO:teuthology.orchestra.run.smithi005.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 151 kB/s | 15 kB 00:00 2024-04-26T21:34:45.345 INFO:teuthology.orchestra.run.smithi005.stdout:(116/152): python3-cheroot-8.6.0-4.el9.noarch.r 646 kB/s | 172 kB 00:00 2024-04-26T21:34:45.881 INFO:teuthology.orchestra.run.smithi005.stdout:(117/152): python3-cherrypy-18.6.1-2.el9.noarch 670 kB/s | 358 kB 00:00 2024-04-26T21:34:46.321 INFO:teuthology.orchestra.run.smithi005.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 691 kB/s | 303 kB 00:00 2024-04-26T21:34:46.429 INFO:teuthology.orchestra.run.smithi005.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 328 kB/s | 35 kB 00:00 2024-04-26T21:34:46.780 INFO:teuthology.orchestra.run.smithi005.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 589 kB/s | 206 kB 00:00 2024-04-26T21:34:47.397 INFO:teuthology.orchestra.run.smithi005.stdout:(121/152): libarrow-9.0.0-11.el9.x86_64.rpm 840 kB/s | 4.4 MB 00:05 2024-04-26T21:34:47.664 INFO:teuthology.orchestra.run.smithi005.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 544 kB/s | 144 kB 00:00 2024-04-26T21:34:47.772 INFO:teuthology.orchestra.run.smithi005.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-04-26T21:34:47.881 INFO:teuthology.orchestra.run.smithi005.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2024-04-26T21:34:48.019 INFO:teuthology.orchestra.run.smithi005.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 168 kB/s | 23 kB 00:00 2024-04-26T21:34:48.156 INFO:teuthology.orchestra.run.smithi005.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 143 kB/s | 19 kB 00:00 2024-04-26T21:34:48.265 INFO:teuthology.orchestra.run.smithi005.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 183 kB/s | 20 kB 00:00 2024-04-26T21:34:49.348 INFO:teuthology.orchestra.run.smithi005.stdout:(128/152): python3-grpcio-1.46.7-10.el9.x86_64. 813 kB/s | 2.0 MB 00:02 2024-04-26T21:34:49.499 INFO:teuthology.orchestra.run.smithi005.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 310 kB/s | 46 kB 00:00 2024-04-26T21:34:49.624 INFO:teuthology.orchestra.run.smithi005.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 770 kB/s | 1.0 MB 00:01 2024-04-26T21:34:49.724 INFO:teuthology.orchestra.run.smithi005.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 351 kB/s | 79 kB 00:00 2024-04-26T21:34:49.875 INFO:teuthology.orchestra.run.smithi005.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 231 kB/s | 58 kB 00:00 2024-04-26T21:34:50.000 INFO:teuthology.orchestra.run.smithi005.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 132 kB/s | 16 kB 00:00 2024-04-26T21:34:50.192 INFO:teuthology.orchestra.run.smithi005.stdout:(134/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 471 kB/s | 90 kB 00:00 2024-04-26T21:34:50.250 INFO:teuthology.orchestra.run.smithi005.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 519 kB/s | 272 kB 00:00 2024-04-26T21:34:50.317 INFO:teuthology.orchestra.run.smithi005.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 226 kB/s | 28 kB 00:00 2024-04-26T21:34:50.376 INFO:teuthology.orchestra.run.smithi005.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 247 kB/s | 31 kB 00:00 2024-04-26T21:34:50.608 INFO:teuthology.orchestra.run.smithi005.stdout:(138/152): python3-rsa-4.9-2.el9.noarch.rpm 256 kB/s | 59 kB 00:00 2024-04-26T21:34:50.643 INFO:teuthology.orchestra.run.smithi005.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 580 kB/s | 188 kB 00:00 2024-04-26T21:34:50.735 INFO:teuthology.orchestra.run.smithi005.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 284 kB/s | 36 kB 00:00 2024-04-26T21:34:50.777 INFO:teuthology.orchestra.run.smithi005.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 383 kB/s | 51 kB 00:00 2024-04-26T21:34:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:(142/152): python3-websocket-client-1.2.3-2.el9 415 kB/s | 90 kB 00:00 2024-04-26T21:34:51.103 INFO:teuthology.orchestra.run.smithi005.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 627 kB/s | 230 kB 00:00 2024-04-26T21:34:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:(144/152): python3-zc-lockfile-2.0-10.el9.noarc 186 kB/s | 20 kB 00:00 2024-04-26T21:34:51.495 INFO:teuthology.orchestra.run.smithi005.stdout:(145/152): re2-20211101-3.el9.x86_64.rpm 678 kB/s | 192 kB 00:00 2024-04-26T21:34:51.603 INFO:teuthology.orchestra.run.smithi005.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 702 kB/s | 427 kB 00:00 2024-04-26T21:34:52.020 INFO:teuthology.orchestra.run.smithi005.stdout:(147/152): librados2-19.0.0-3306.gbc612ffb.el9. 8.2 MB/s | 3.4 MB 00:00 2024-04-26T21:34:52.229 INFO:teuthology.orchestra.run.smithi005.stdout:(148/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 15 MB/s | 3.1 MB 00:00 2024-04-26T21:34:52.521 INFO:teuthology.orchestra.run.smithi005.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 4.6 MB/s | 1.3 MB 00:00 2024-04-26T21:34:52.730 INFO:teuthology.orchestra.run.smithi005.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-04-26T21:34:53.572 INFO:teuthology.orchestra.run.smithi005.stdout:(151/152): thrift-0.15.0-2.el9.x86_64.rpm 780 kB/s | 1.6 MB 00:02 2024-04-26T21:34:55.472 INFO:teuthology.orchestra.run.smithi005.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 847 kB/s | 16 MB 00:19 2024-04-26T21:34:55.483 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:34:55.484 INFO:teuthology.orchestra.run.smithi005.stdout:Total 4.1 MB/s | 222 MB 00:53 2024-04-26T21:34:56.537 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:34:56.537 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-04-26T21:34:56.537 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-04-26T21:34:56.537 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-04-26T21:34:56.537 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-04-26T21:34:56.538 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-04-26T21:34:56.538 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-04-26T21:34:56.538 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-04-26T21:34:56.538 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:34:56.766 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:34:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:34:56.813 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:34:56.813 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T21:34:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:34:58.442 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:34:58.446 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-26T21:34:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:34:58.522 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:34:58.522 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T21:34:58.525 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:34:58.526 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:34:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:34:58.724 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-26T21:34:58.725 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-26T21:34:58.768 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:34:58.827 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:34:58.827 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:34:58.827 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T21:34:58.828 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:34:58.828 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:34:58.828 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:34:59.335 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:34:59.403 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:34:59.403 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:34:59.403 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T21:34:59.403 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:34:59.403 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:34:59.403 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:34:59.535 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T21:34:59.596 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T21:34:59.681 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T21:34:59.914 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T21:34:59.972 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T21:35:00.058 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T21:35:00.157 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:35:00.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:35:00.376 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T21:35:00.412 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T21:35:00.446 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T21:35:01.114 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:35:01.167 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:35:01.225 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T21:35:01.331 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T21:35:01.360 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:35:01.379 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-26T21:35:01.379 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-26T21:35:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:35:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:35:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:35:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:35:03.965 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:35:04.142 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T21:35:04.164 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:35:04.234 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:35:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T21:35:04.234 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:35:04.235 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:35:04.235 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:04.306 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:35:04.344 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:35:04.455 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T21:35:04.518 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T21:35:05.519 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T21:35:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:35:05.626 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:35:05.627 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:05.627 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T21:35:05.627 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:35:05.627 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:35:05.627 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:05.676 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:35:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:35:05.745 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:05.745 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T21:35:05.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:05.835 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:35:05.910 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:35:05.911 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:05.911 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T21:35:05.911 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:35:05.911 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:35:05.911 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:06.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:35:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:35:06.350 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:06.350 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T21:35:06.350 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:35:06.350 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:35:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:08.126 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-26T21:35:08.231 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T21:35:08.280 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T21:35:08.373 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T21:35:08.421 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T21:35:08.472 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T21:35:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T21:35:09.036 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T21:35:09.137 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:35:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:35:09.355 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:35:09.495 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:35:09.566 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:35:09.975 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T21:35:10.054 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T21:35:10.085 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:35:10.307 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:35:10.344 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:35:10.440 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:35:10.470 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:35:10.541 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:35:10.849 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:35:10.904 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:35:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T21:35:11.231 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T21:35:11.271 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T21:35:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T21:35:11.380 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T21:35:11.434 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T21:35:11.447 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T21:35:11.500 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T21:35:11.507 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T21:35:11.548 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T21:35:11.575 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T21:35:11.596 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T21:35:11.631 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T21:35:11.670 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T21:35:11.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T21:35:11.866 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T21:35:11.904 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T21:35:11.906 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T21:35:11.959 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T21:35:11.963 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T21:35:11.987 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T21:35:12.072 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T21:35:12.125 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T21:35:12.161 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T21:35:12.206 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T21:35:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T21:35:12.378 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T21:35:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T21:35:12.675 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T21:35:12.738 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T21:35:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:35:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:35:12.981 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:35:13.429 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T21:35:13.528 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T21:35:13.570 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T21:35:13.615 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T21:35:13.657 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T21:35:13.716 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T21:35:13.988 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T21:35:14.074 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T21:35:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T21:35:14.258 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T21:35:14.273 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T21:35:14.307 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T21:35:14.346 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T21:35:14.392 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T21:35:14.416 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T21:35:14.462 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T21:35:14.474 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T21:35:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T21:35:14.594 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T21:35:14.669 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T21:35:14.715 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T21:35:14.715 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:35:14.811 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T21:35:14.822 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:35:14.867 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T21:35:14.871 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:35:14.871 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:35:14.905 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T21:35:14.954 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T21:35:15.012 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:35:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T21:35:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:35:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T21:35:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T21:35:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T21:35:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T21:35:15.439 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:35:15.439 INFO:teuthology.orchestra.run.smithi112.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T21:35:15.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T21:35:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T21:35:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T21:35:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T21:35:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T21:35:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T21:35:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T21:35:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T21:35:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T21:35:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T21:35:16.399 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T21:35:16.443 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T21:35:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T21:35:16.679 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T21:35:16.723 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T21:35:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T21:35:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T21:35:17.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T21:35:18.003 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T21:35:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T21:35:18.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T21:35:18.212 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T21:35:18.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T21:35:18.395 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T21:35:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T21:35:18.693 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T21:35:18.733 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T21:35:18.833 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T21:35:19.722 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T21:35:19.878 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T21:35:21.223 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T21:35:21.223 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T21:35:21.223 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T21:35:21.223 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T21:35:21.223 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T21:35:21.224 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T21:35:21.225 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T21:35:21.237 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T21:35:21.237 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T21:35:21.237 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T21:35:21.237 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T21:35:21.238 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T21:35:21.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T21:35:21.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T21:35:21.241 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T21:35:21.242 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T21:35:21.243 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T21:35:21.244 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T21:35:21.245 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:35:21.246 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T21:35:21.564 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T21:35:21.664 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T21:35:21.704 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T21:35:21.765 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T21:35:22.176 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T21:35:22.226 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:35:22.351 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:35:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T21:35:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T21:35:23.032 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T21:35:23.071 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:35:23.181 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:35:23.206 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T21:35:23.599 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:35:23.599 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:23.599 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.600 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.601 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T21:35:23.602 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.603 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T21:35:23.604 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T21:35:23.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T21:35:23.606 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T21:35:23.607 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T21:35:23.608 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T21:35:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T21:35:23.610 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T21:35:23.611 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T21:35:23.611 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T21:35:23.611 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T21:35:23.611 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T21:35:23.611 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T21:35:23.611 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:35:23.611 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-26T21:35:24.178 DEBUG:teuthology.parallel:result is None 2024-04-26T21:35:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:35:25.994 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:35:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:35:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:35:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:35:26.917 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T21:35:26.917 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T21:35:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:35:40.598 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:35:40.598 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-04-26T21:35:40.598 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-04-26T21:35:40.598 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-04-26T21:35:40.598 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-04-26T21:35:40.599 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-04-26T21:35:40.599 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-04-26T21:35:40.599 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-04-26T21:35:40.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:40.827 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:35:40.877 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:35:40.877 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:40.877 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T21:35:40.877 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:42.579 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:35:42.662 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:35:42.662 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:42.662 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T21:35:42.662 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:35:42.662 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:35:42.662 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:35:43.010 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:35:43.010 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:43.011 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T21:35:43.011 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:35:43.011 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:35:43.011 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:43.522 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:35:43.592 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:35:43.592 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:43.592 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T21:35:43.593 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:35:43.593 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:35:43.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:43.732 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T21:35:43.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T21:35:43.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T21:35:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T21:35:44.187 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T21:35:44.278 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T21:35:44.390 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:35:44.575 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:35:44.631 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T21:35:44.678 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T21:35:44.742 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T21:35:45.582 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:35:45.629 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:35:45.691 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T21:35:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T21:35:45.846 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:35:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:35:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:35:48.442 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:35:48.473 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:35:48.626 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:35:48.837 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T21:35:48.866 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:35:48.941 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:35:48.941 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:48.941 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T21:35:48.941 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:35:48.941 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:35:48.941 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:49.001 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:35:49.039 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:35:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T21:35:49.278 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T21:35:50.373 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T21:35:50.403 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:35:50.479 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:35:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T21:35:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:35:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:35:50.479 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:50.529 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:35:50.620 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:35:50.620 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:50.620 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T21:35:50.620 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:35:50.788 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:35:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T21:35:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:35:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:35:50.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:51.180 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:35:51.266 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:35:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:35:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T21:35:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:35:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:35:51.267 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:35:56.594 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T21:35:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T21:35:56.749 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T21:35:56.791 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T21:35:56.839 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T21:35:57.183 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T21:35:57.240 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T21:35:57.268 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T21:35:58.218 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:35:58.266 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:35:58.337 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:35:59.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T21:35:59.930 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T21:36:00.021 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T21:36:00.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T21:36:00.237 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T21:36:00.237 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:36:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:36:00.444 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:36:00.445 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:36:00.585 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:36:00.758 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:36:01.050 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:36:01.050 INFO:teuthology.orchestra.run.smithi005.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T21:36:01.050 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T21:36:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T21:36:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T21:36:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T21:36:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T21:36:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T21:36:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T21:36:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T21:36:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T21:36:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T21:36:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T21:36:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T21:36:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T21:36:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T21:36:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T21:36:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T21:36:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T21:36:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T21:36:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T21:36:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:36:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T21:36:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:36:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:09.300 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-04-26T21:36:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.301 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T21:36:09.303 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T21:36:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T21:36:09.305 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T21:36:09.306 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T21:36:09.307 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T21:36:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T21:36:09.309 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T21:36:09.310 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T21:36:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T21:36:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T21:36:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T21:36:09.313 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T21:36:09.314 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T21:36:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T21:36:09.315 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:09.315 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-26T21:36:09.895 DEBUG:teuthology.parallel:result is None 2024-04-26T21:36:09.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:36:10.117 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T21:36:10.175 INFO:teuthology.orchestra.run.smithi005.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T21:36:10.175 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T21:36:10.176 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T21:36:10.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:36:10.318 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T21:36:10.390 INFO:teuthology.orchestra.run.smithi112.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T21:36:10.390 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T21:36:10.390 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T21:36:10.392 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T21:36:10.393 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:10.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:36:10.475 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:10.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:36:10.568 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T21:36:10.568 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:10.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:36:10.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:36:10.748 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:10.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:36:10.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:36:10.950 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T21:36:10.951 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:10.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:36:11.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:36:11.146 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:11.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:36:11.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:36:11.330 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T21:36:11.330 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:11.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:36:11.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:36:11.504 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:11.504 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:36:11.576 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:36:11.692 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T21:36:11.789 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T21:36:11.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-04-26T21:36:11.794 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-04-26T21:36:11.861 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T21:36:11.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T21:36:11.866 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T21:36:11.932 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T21:36:11.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T21:36:11.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T21:36:12.011 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T21:36:12.011 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T21:36:12.011 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T21:36:12.012 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:12.012 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T21:36:12.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T21:36:12.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T21:36:12.310 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:12.310 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T21:36:12.355 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T21:36:12.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T21:36:12.663 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T21:36:12.663 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T21:36:12.663 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc}', 'email': None, 'first_in_suite': False, 'job_id': '7675220', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoipGnaObwJKVsknoMvVL7UoO4eYn6G3zWZCMshjUIGNN1vekOT15HLHDU5nj4WM24qq0ocYu41U7NH/GaA8IA=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6Rxo8Qq5zUJioo4/nhjMEx053If3+OQGv32gElKoPqL41ZN+Z33jyH9FTYtIHo4v11oqy2VZEAQKcNZ9ruFNg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T21:36:12.664 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T21:36:12.669 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T21:36:12.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T21:36:12.755 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T21:36:12.846 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:12.846 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:36:12.884 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:36:12.884 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-26 21:36:01.606168784 +0000 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-26 21:33:07.017096145 +0000 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-26 21:33:07.017096145 +0000 2024-04-26T21:36:12.966 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-26 21:33:07.017096145 +0000 2024-04-26T21:36:12.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:36:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-26T21:36:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-26T21:36:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000223387 s, 2.3 MB/s 2024-04-26T21:36:13.067 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:36:13.109 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-04-26T21:36:13.198 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:36:13.198 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:13.198 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-26T21:36:13.198 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:13.199 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:13.199 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-26 21:36:01.607168764 +0000 2024-04-26T21:36:13.199 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-26 21:33:07.616084145 +0000 2024-04-26T21:36:13.199 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-26 21:33:07.616084145 +0000 2024-04-26T21:36:13.199 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-26 21:33:07.616084145 +0000 2024-04-26T21:36:13.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:36:13.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-26T21:36:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-26T21:36:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000180825 s, 2.8 MB/s 2024-04-26T21:36:13.267 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:36:13.307 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-26 21:36:01.608168744 +0000 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-26 21:33:08.233071785 +0000 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-26 21:33:08.233071785 +0000 2024-04-26T21:36:13.395 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-26 21:33:08.233071785 +0000 2024-04-26T21:36:13.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:36:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-26T21:36:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-26T21:36:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000262405 s, 2.0 MB/s 2024-04-26T21:36:13.469 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:36:13.519 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-04-26T21:36:13.557 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:36:13.557 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:13.557 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-26T21:36:13.557 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:13.557 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:13.557 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-26 21:36:01.608168744 +0000 2024-04-26T21:36:13.558 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-26 21:33:08.811060207 +0000 2024-04-26T21:36:13.558 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-26 21:33:08.811060207 +0000 2024-04-26T21:36:13.558 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-26 21:33:08.811060207 +0000 2024-04-26T21:36:13.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:36:13.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-26T21:36:13.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-26T21:36:13.665 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000251549 s, 2.0 MB/s 2024-04-26T21:36:13.669 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:36:13.713 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:13.713 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:13.713 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:36:13.772 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:36:13.773 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:35:15.964028247 +0000 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:32:59.778824289 +0000 2024-04-26T21:36:13.826 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:32:59.778824289 +0000 2024-04-26T21:36:13.827 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:32:59.778824289 +0000 2024-04-26T21:36:13.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:36:13.906 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:36:13.906 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:36:13.906 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000367506 s, 1.4 MB/s 2024-04-26T21:36:13.909 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:36:13.967 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-04-26T21:36:14.016 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:35:15.965028221 +0000 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:33:00.396808168 +0000 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:33:00.396808168 +0000 2024-04-26T21:36:14.017 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:33:00.396808168 +0000 2024-04-26T21:36:14.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:36:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:36:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:36:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000346887 s, 1.5 MB/s 2024-04-26T21:36:14.095 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:36:14.147 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:35:15.966028195 +0000 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:33:00.987792752 +0000 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:33:00.987792752 +0000 2024-04-26T21:36:14.198 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:33:00.987792752 +0000 2024-04-26T21:36:14.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:36:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:36:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:36:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000352868 s, 1.5 MB/s 2024-04-26T21:36:14.278 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:36:14.333 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-04-26T21:36:14.383 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:36:14.383 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:36:14.383 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-26T21:36:14.384 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:36:14.384 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:36:14.384 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:35:15.967028169 +0000 2024-04-26T21:36:14.384 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:33:01.725773501 +0000 2024-04-26T21:36:14.384 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:33:01.725773501 +0000 2024-04-26T21:36:14.384 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:33:01.725773501 +0000 2024-04-26T21:36:14.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:36:14.460 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:36:14.461 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:36:14.461 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000339883 s, 1.5 MB/s 2024-04-26T21:36:14.464 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:36:14.519 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:14.519 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T21:36:14.519 INFO:tasks.ceph:Generating config... 2024-04-26T21:36:14.520 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T21:36:14.520 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T21:36:14.520 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T21:36:14.520 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T21:36:14.520 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T21:36:14.520 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T21:36:14.520 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds inject traceless reply probability = 0.5 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T21:36:14.521 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T21:36:14.522 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T21:36:14.522 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T21:36:14.522 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T21:36:14.522 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T21:36:14.522 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T21:36:14.522 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T21:36:14.522 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T21:36:14.523 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T21:36:14.523 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T21:36:14.523 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T21:36:14.523 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T21:36:14.523 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T21:36:14.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T21:36:14.640 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T21:36:14.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T21:36:14.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:36:14.818 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.112'), ('mon.c', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]')] 2024-04-26T21:36:14.819 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T21:36:14.820 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:14.820 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T21:36:14.859 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.112 --addv c '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid a3a415d8-7c54-4abb-9c5e-72229b6eddf5 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:fsid a3a415d8-7c54-4abb-9c5e-72229b6eddf5 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-04-26T21:36:14.986343+0000 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-26T21:36:14.986343+0000 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 17 (quincy) 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-04-26T21:36:14.986 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-04-26T21:36:14.987 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-04-26T21:36:14.987 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.c 2024-04-26T21:36:14.987 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T21:36:14.989 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T21:36:15.027 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a3a415d8-7c54-4abb-9c5e-72229b6eddf5... 2024-04-26T21:36:15.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T21:36:15.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T21:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-04-26T21:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-04-26T21:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T21:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-04-26T21:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T21:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = a3a415d8-7c54-4abb-9c5e-72229b6eddf5 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-04-26T21:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-26T21:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: mon down mkfs grace = 300 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-04-26T21:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-04-26T21:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds bal fragment size max = 10000 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds bal merge size = 5 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds bal split bits = 3 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds bal split size = 100 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds inject traceless reply probability = 0.5 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-04-26T21:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-04-26T21:36:15.210 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-04-26T21:36:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-04-26T21:36:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T21:36:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-04-26T21:36:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.210 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T21:36:15.211 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.212 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.5,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = a3a415d8-7c54-4abb-9c5e-72229b6eddf5 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-04-26T21:36:15.213 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-04-26T21:36:15.214 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-04-26T21:36:15.215 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:36:15.216 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T21:36:15.217 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-04-26T21:36:15.218 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-04-26T21:36:15.219 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal fragment size max = 10000 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal merge size = 5 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal split bits = 3 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds bal split size = 100 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds inject traceless reply probability = 0.5 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-04-26T21:36:15.220 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-04-26T21:36:15.245 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T21:36:15.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T21:36:15.354 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T21:36:15.355 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:15.355 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T21:36:15.393 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:15.393 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T21:36:15.477 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T21:36:15.477 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:15.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T21:36:15.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:36:15.606 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:15.606 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:15.690 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:36:15.690 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:15.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T21:36:15.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:36:15.811 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:15.811 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:15.924 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T21:36:15.926 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T21:36:15.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T21:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T21:36:16.057 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T21:36:16.233 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T21:36:16.242 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T21:36:16.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T21:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T21:36:16.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T21:36:16.442 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T21:36:16.587 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T21:36:16.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T21:36:16.677 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T21:36:16.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T21:36:16.772 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T21:36:16.803 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T21:36:16.803 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T21:36:16.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T21:36:16.870 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:16.870 INFO:tasks.ceph:role: osd.0 2024-04-26T21:36:16.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T21:36:16.870 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T21:36:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:16.931 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-26T21:36:16.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-26T21:36:16.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T21:36:17.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T21:36:17.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T21:36:17.184 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:17.184 INFO:tasks.ceph:role: osd.1 2024-04-26T21:36:17.184 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T21:36:17.185 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T21:36:17.250 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:17.250 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:17.250 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:17.251 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:17.251 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:17.251 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:17.251 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:17.251 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:17.251 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:17.251 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:17.284 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-26T21:36:17.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-26T21:36:17.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T21:36:17.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T21:36:17.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T21:36:17.501 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:17.501 INFO:tasks.ceph:role: osd.2 2024-04-26T21:36:17.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T21:36:17.502 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T21:36:17.561 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:17.562 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:17.595 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-26T21:36:17.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-26T21:36:17.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T21:36:17.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T21:36:17.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T21:36:17.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:17.815 INFO:tasks.ceph:role: osd.3 2024-04-26T21:36:17.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T21:36:17.815 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T21:36:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:17.885 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:17.918 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-04-26T21:36:17.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-04-26T21:36:17.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T21:36:18.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T21:36:18.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:18.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:18.242+0000 7fef73fbe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T21:36:18.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:18.243+0000 7fef73fbe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T21:36:18.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:18.243+0000 7fef73fbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:36:18.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:18.243+0000 7fef73fbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:36:18.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:18.243+0000 7fef73fbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:36:18.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:18.247+0000 7fef73fbe640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T21:36:21.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:36:21.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:21.713+0000 7f73cd40d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T21:36:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:21.714+0000 7f73cd40d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T21:36:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:21.714+0000 7f73cd40d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:36:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:21.714+0000 7f73cd40d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:36:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:21.714+0000 7f73cd40d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:36:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:21.717+0000 7f73cd40d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T21:36:24.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:36:25.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:25.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:25.183+0000 7ffa2a218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T21:36:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:25.183+0000 7ffa2a218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T21:36:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:25.183+0000 7ffa2a218640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:36:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:25.183+0000 7ffa2a218640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:36:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:25.183+0000 7ffa2a218640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:36:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:25.186+0000 7ffa2a218640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T21:36:28.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:36:28.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:28.630+0000 7f0a2fd31640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T21:36:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:28.630+0000 7f0a2fd31640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T21:36:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:28.630+0000 7f0a2fd31640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:36:28.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:28.630+0000 7f0a2fd31640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:36:28.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:28.630+0000 7f0a2fd31640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:36:28.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:28.632+0000 7f0a2fd31640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T21:36:31.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:36:31.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T21:36:31.794 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:31.794 INFO:tasks.ceph:role: osd.4 2024-04-26T21:36:31.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:36:31.794 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T21:36:31.879 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:31.879 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:31.879 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:31.880 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:31.880 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:31.880 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:31.880 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:31.880 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:31.880 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:31.880 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:32.294 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:36:32.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:36:32.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T21:36:32.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T21:36:32.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T21:36:32.622 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:32.622 INFO:tasks.ceph:role: osd.5 2024-04-26T21:36:32.623 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:36:32.623 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T21:36:32.706 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:32.707 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:33.064 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:36:33.070 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:36:33.070 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T21:36:33.191 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T21:36:33.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T21:36:33.347 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:33.347 INFO:tasks.ceph:role: osd.6 2024-04-26T21:36:33.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:36:33.347 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T21:36:33.433 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:33.434 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:33.434 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:33.434 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:33.434 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:33.827 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:36:33.833 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:36:33.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T21:36:33.986 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T21:36:34.077 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T21:36:34.159 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:36:34.159 INFO:tasks.ceph:role: osd.7 2024-04-26T21:36:34.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:36:34.159 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:36:34.247 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:36:34.653 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:36:34.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:36:34.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T21:36:34.812 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T21:36:34.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:35.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:35.041+0000 7fbf62416640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T21:36:35.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:35.041+0000 7fbf62416640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T21:36:35.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:35.042+0000 7fbf62416640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:36:35.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:35.042+0000 7fbf62416640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:36:35.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:35.042+0000 7fbf62416640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:36:35.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:35.045+0000 7fbf62416640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T21:36:38.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:36:38.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:38.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:38.248+0000 7f4fedb21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T21:36:38.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:38.248+0000 7f4fedb21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T21:36:38.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:38.248+0000 7f4fedb21640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:36:38.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:38.248+0000 7f4fedb21640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:36:38.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:38.248+0000 7f4fedb21640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:36:38.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:38.250+0000 7f4fedb21640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T21:36:41.219 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:36:41.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:41.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:41.428+0000 7fdb58314640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T21:36:41.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:41.428+0000 7fdb58314640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T21:36:41.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:41.429+0000 7fdb58314640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:36:41.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:41.429+0000 7fdb58314640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:36:41.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:41.429+0000 7fdb58314640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:36:41.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:41.431+0000 7fdb58314640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T21:36:42.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:36:42.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:36:44.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T21:36:44.490 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:44.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:44.615+0000 7f08503cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T21:36:44.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:44.616+0000 7f08503cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T21:36:44.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:44.616+0000 7f08503cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:36:44.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:44.616+0000 7f08503cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:36:44.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:44.616+0000 7f08503cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:36:44.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:44.618+0000 7f08503cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T21:36:47.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T21:36:47.911 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T21:36:47.912 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:47.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T21:36:48.007 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:48.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T21:36:48.097 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:48.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T21:36:48.190 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:48.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T21:36:48.266 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:48.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T21:36:48.352 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:48.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T21:36:48.438 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:48.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T21:36:48.527 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:48.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T21:36:48.610 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:48.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T21:36:48.692 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:48.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T21:36:48.778 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:48.778 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T21:36:48.861 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:48.861 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T21:36:48.989 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:48.989 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T21:36:49.050 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T21:36:49.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T21:36:49.056 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T21:36:49.131 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-04-26T21:36:49.131 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBQHixmQ3YGAxAA+14h9XoKHzb1BY1jySZHMQ== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBQHixmFYANFhAAZLN+zB6isjI/A/bC1qQIlg== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBSHixmv4WPDhAAbxPWUJGOBh8jme6/G8+FRA== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBVHixmqLumKhAAAkQTG19MOq80FvgGTGVbsA== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBZHixmfqQCCxAA0x20+n+w4eUzLo0g1uAruA== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBcHixm2falJRAAWeGeQOEhUiVFtMyo+7rNiQ== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBQHixmk6PsDRAAzb7g53IR5FYXv9zqdvEyiQ== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBQHixmRxsJIxAApQD/yGcQRAe8It/Usqm+dQ== 2024-04-26T21:36:49.132 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBjHixmCgCRAhAAwjGwgNxTKQAmB0JKUpiz/w== 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBmHixm3VfdDhAAqg0flSuY3+KZreECZp/zqA== 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBpHixmQEGVGRAAo+dDZi5xlyxUkwmDoAM9wQ== 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBsHixmpjvBJBAA4D7yrARYPO6Bh7LbRIsxUQ== 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-26T21:36:49.133 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBQHixmiSIVLhAA6QGFspZPieDRKiWFoLrY5w== 2024-04-26T21:36:49.135 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-04-26T21:36:49.135 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBQHixmQ3YGAxAA+14h9XoKHzb1BY1jySZHMQ== 2024-04-26T21:36:49.135 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-04-26T21:36:49.135 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBQHixmFYANFhAAZLN+zB6isjI/A/bC1qQIlg== 2024-04-26T21:36:49.135 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBSHixmv4WPDhAAbxPWUJGOBh8jme6/G8+FRA== 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBVHixmqLumKhAAAkQTG19MOq80FvgGTGVbsA== 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBZHixmfqQCCxAA0x20+n+w4eUzLo0g1uAruA== 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBcHixm2falJRAAWeGeQOEhUiVFtMyo+7rNiQ== 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBQHixmk6PsDRAAzb7g53IR5FYXv9zqdvEyiQ== 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBQHixmRxsJIxAApQD/yGcQRAe8It/Usqm+dQ== 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBjHixmCgCRAhAAwjGwgNxTKQAmB0JKUpiz/w== 2024-04-26T21:36:49.136 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-04-26T21:36:49.137 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBmHixm3VfdDhAAqg0flSuY3+KZreECZp/zqA== 2024-04-26T21:36:49.137 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-04-26T21:36:49.137 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpHixmQEGVGRAAo+dDZi5xlyxUkwmDoAM9wQ== 2024-04-26T21:36:49.137 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-04-26T21:36:49.137 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBsHixmpjvBJBAA4D7yrARYPO6Bh7LbRIsxUQ== 2024-04-26T21:36:49.137 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-04-26T21:36:49.137 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBQHixmiSIVLhAA6QGFspZPieDRKiWFoLrY5w== 2024-04-26T21:36:49.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:36:49.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:36:49.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:36:49.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:36:49.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:49.471 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:49.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:49.603 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:49.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:49.743 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:49.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:49.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:36:50.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:36:50.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:36:50.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:36:50.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.298 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.721 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:36:50.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:36:50.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:36:51.000 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T21:36:51.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T21:36:51.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:36:51.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T21:36:51.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T21:36:51.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:36:51.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T21:36:51.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T21:36:51.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:36:51.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T21:36:51.946 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:51.953 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:36:52.006 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T21:36:52.006 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T21:36:52.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T21:36:52.012 INFO:tasks.ceph.mon.a:Started 2024-04-26T21:36:52.012 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T21:36:52.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T21:36:52.017 INFO:tasks.ceph.mon.b:Started 2024-04-26T21:36:52.017 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T21:36:52.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T21:36:52.024 INFO:tasks.ceph.mon.c:Started 2024-04-26T21:36:52.024 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T21:36:52.024 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T21:36:52.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T21:36:52.030 INFO:tasks.ceph.mgr.y:Started 2024-04-26T21:36:52.031 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T21:36:52.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T21:36:52.035 INFO:tasks.ceph.mgr.x:Started 2024-04-26T21:36:52.035 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T21:36:52.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T21:36:52.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.212+0000 7fdd66400640 1 Processor -- start 2024-04-26T21:36:52.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.212+0000 7fdd66400640 1 -- start start 2024-04-26T21:36:52.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.213+0000 7fdd66400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd60148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:52.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.213+0000 7fdd66400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd600b8bf0 con 0x7fdd601421a0 2024-04-26T21:36:52.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.213+0000 7fdd66400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd600b6d90 con 0x7fdd600b87d0 2024-04-26T21:36:52.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.213+0000 7fdd66400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdd601487d0 con 0x7fdd600b69b0 2024-04-26T21:36:52.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.213+0000 7fdd65000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd60148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:52.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.214+0000 7fdd65000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd60148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:34020/0 (socket says 172.21.15.5:34020) 2024-04-26T21:36:52.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.214+0000 7fdd65000640 1 -- 172.21.15.5:0/4167632768 learned_addr learned my addr 172.21.15.5:0/4167632768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:36:52.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.214+0000 7fdd5fe00640 1 --1- 172.21.15.5:0/4167632768 >> v1:172.21.15.112:6789/0 conn(0x7fdd600b87d0 0x7fdd600b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:38754/0 (socket says 172.21.15.5:38754) 2024-04-26T21:36:52.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.214+0000 7fdd65000640 1 -- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 msgr2=0x7fdd60148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T21:36:52.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.214+0000 7fdd65000640 1 -- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 msgr2=0x7fdd60148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:36:52.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.214+0000 7fdd65000640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd60148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:36:52.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.214+0000 7fdd65000640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd60148fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:36:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.223+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1828572009 0 0) 0x7fdd600b8bf0 con 0x7fdd601421a0 2024-04-26T21:36:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.223+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd48003520 con 0x7fdd601421a0 2024-04-26T21:36:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1308742789 0 0) 0x7fdd48003520 con 0x7fdd601421a0 2024-04-26T21:36:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 msgr2=0x7fdd60148fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T21:36:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd60148fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 >> v1:172.21.15.112:6789/0 conn(0x7fdd600b87d0 legacy=0x7fdd600b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd60148ab0 con 0x7fdd601421a0 2024-04-26T21:36:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fdd580019f0 con 0x7fdd601421a0 2024-04-26T21:36:52.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 >> v1:172.21.15.5:6789/0 conn(0x7fdd601421a0 legacy=0x7fdd60142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd48004060 0x7fdd48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd48004d40 0x7fdd480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdd601487d0 con 0x7fdd48004060 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4800bca0 con 0x7fdd48004d40 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4800bea0 con 0x7fdd600b69b0 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.224+0000 7fdd65000640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd48004060 0x7fdd48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd65a00640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd48004d40 0x7fdd480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd65000640 1 -- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd48004d40 msgr2=0x7fdd480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd65000640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd48004d40 0x7fdd480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd65000640 1 -- 172.21.15.5:0/4167632768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd48004060 msgr2=0x7fdd48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd65000640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd48004060 0x7fdd48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd65000640 1 -- 172.21.15.5:0/4167632768 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd48003520 con 0x7fdd600b69b0 2024-04-26T21:36:52.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.225+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd48004060 0x7fdd48004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:36:52.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.226+0000 7fdd65000640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd480039e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009890 tx=0x7fdd48005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ceff4b0079526fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:52.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.228+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd54037070 con 0x7fdd600b69b0 2024-04-26T21:36:52.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.228+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5402ad00 con 0x7fdd600b69b0 2024-04-26T21:36:52.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.228+0000 7fdd5f400640 1 -- 172.21.15.5:0/4167632768 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400f040 con 0x7fdd600b69b0 2024-04-26T21:36:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.229+0000 7fdd66400640 1 -- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 msgr2=0x7fdd480039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.229+0000 7fdd66400640 1 --2- 172.21.15.5:0/4167632768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd600b69b0 0x7fdd480039e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009890 tx=0x7fdd48005830 comp rx=0 tx=0).stop 2024-04-26T21:36:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.229+0000 7fdd65a00640 1 -- 172.21.15.5:0/4167632768 reap_dead start 2024-04-26T21:36:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.229+0000 7fdd66400640 1 -- 172.21.15.5:0/4167632768 shutdown_connections 2024-04-26T21:36:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.229+0000 7fdd66400640 1 -- 172.21.15.5:0/4167632768 >> 172.21.15.5:0/4167632768 conn(0x7fdd600bde50 msgr2=0x7fdd600be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.229+0000 7fdd66400640 1 -- 172.21.15.5:0/4167632768 shutdown_connections 2024-04-26T21:36:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.229+0000 7fdd66400640 1 -- 172.21.15.5:0/4167632768 wait complete. 2024-04-26T21:36:52.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.231+0000 7fdd66400640 1 Processor -- start 2024-04-26T21:36:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.231+0000 7fdd66400640 1 -- start start 2024-04-26T21:36:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.231+0000 7fdd66400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd600b69b0 0x7fdd6013d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd66400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd601e1030 0x7fdd601e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd66400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd60144190 0x7fdd60144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd66400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600ba720 con 0x7fdd60144190 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd66400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600ba5a0 con 0x7fdd600b69b0 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd66400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdd60148fd0 con 0x7fdd601e1030 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd60144190 0x7fdd60144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd60144190 0x7fdd60144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59830/0 (socket says 172.21.15.5:59830) 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 -- 172.21.15.5:0/881274876 learned_addr learned my addr 172.21.15.5:0/881274876 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd601e1030 0x7fdd601e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65000640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd600b69b0 0x7fdd6013d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 -- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd601e1030 msgr2=0x7fdd601e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd601e1030 0x7fdd601e14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 -- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd600b69b0 msgr2=0x7fdd6013d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd600b69b0 0x7fdd6013d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.232+0000 7fdd65a00640 1 -- 172.21.15.5:0/881274876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd601e19f0 con 0x7fdd60144190 2024-04-26T21:36:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.233+0000 7fdd65a00640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd60144190 0x7fdd60144610 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdd60142580 tx=0x7fdd5800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.233+0000 7fdd5cc00640 1 -- 172.21.15.5:0/881274876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0013a0 con 0x7fdd60144190 2024-04-26T21:36:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.233+0000 7fdd5cc00640 1 -- 172.21.15.5:0/881274876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd58018070 con 0x7fdd60144190 2024-04-26T21:36:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.233+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd60145860 con 0x7fdd60144190 2024-04-26T21:36:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.233+0000 7fdd5cc00640 1 -- 172.21.15.5:0/881274876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58003dc0 con 0x7fdd60144190 2024-04-26T21:36:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.233+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6013daf0 con 0x7fdd60144190 2024-04-26T21:36:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.233+0000 7fdd5cc00640 1 -- 172.21.15.5:0/881274876 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd580050d0 con 0x7fdd60144190 2024-04-26T21:36:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.234+0000 7fdd5cc00640 1 -- 172.21.15.5:0/881274876 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdd5800de40 con 0x7fdd60144190 2024-04-26T21:36:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.234+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd60075db0 con 0x7fdd60144190 2024-04-26T21:36:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.237+0000 7fdd5cc00640 1 -- 172.21.15.5:0/881274876 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fdd601e19f0 con 0x7fdd60144190 2024-04-26T21:36:52.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.310+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fdd601cefc0 con 0x7fdd60144190 2024-04-26T21:36:52.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.313+0000 7fdd5cc00640 1 -- 172.21.15.5:0/881274876 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fdd5800d6e0 con 0x7fdd60144190 2024-04-26T21:36:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.314+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd60144190 msgr2=0x7fdd60144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.314+0000 7fdd66400640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd60144190 0x7fdd60144610 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdd60142580 tx=0x7fdd5800fec0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.315+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 shutdown_connections 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.315+0000 7fdd66400640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd60144190 0x7fdd60144610 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.315+0000 7fdd66400640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd601e1030 0x7fdd601e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.315+0000 7fdd66400640 1 --2- 172.21.15.5:0/881274876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd600b69b0 0x7fdd6013d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.315+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 >> 172.21.15.5:0/881274876 conn(0x7fdd600bde50 msgr2=0x7fdd600b8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.315+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 shutdown_connections 2024-04-26T21:36:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:52.315+0000 7fdd66400640 1 -- 172.21.15.5:0/881274876 wait complete. 2024-04-26T21:36:52.332 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T21:36:52.333 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T21:36:52.333 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:52.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T21:36:52.406 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:52.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T21:36:52.518 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:52.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T21:36:52.519 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:52.518+0000 7f108d5b6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T21:36:52.536 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:52.535+0000 7febf160f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T21:36:52.606 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:36:52.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T21:36:52.727 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:52.726+0000 7f108d5b6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:36:52.729 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:52.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T21:36:52.736 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:52.736+0000 7febf160f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:36:52.798 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:52.797+0000 7f108d5b6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T21:36:52.805 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:52.805+0000 7febf160f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T21:36:52.810 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:52.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T21:36:52.875 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:52.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T21:36:52.997 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:36:52.998 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T21:36:53.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 054c9b7f-cfba-42b9-ab0c-8e001c866ec4 0 2024-04-26T21:36:53.098 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:53.098+0000 7f108d5b6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T21:36:53.123 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:53.123+0000 7febf160f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T21:36:53.154 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:53.154+0000 7f108d5b6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T21:36:53.179 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:53.179+0000 7febf160f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T21:36:53.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.281+0000 7f9d88a00640 1 Processor -- start 2024-04-26T21:36:53.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.281+0000 7f9d88a00640 1 -- start start 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.282+0000 7f9d88a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d840be7e0 0x7f9d8414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.282+0000 7f9d88a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d8414c090 0x7f9d84142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.282+0000 7f9d88a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8414c520 con 0x7f9d84142660 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.282+0000 7f9d88a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9d840bebc0 con 0x7f9d840be7e0 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.282+0000 7f9d88a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9d840b7cf0 con 0x7f9d8414c090 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.283+0000 7f9d81e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d8414c090 0x7f9d84142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.283+0000 7f9d81e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d8414c090 0x7f9d84142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43332/0 (socket says 172.21.15.112:43332) 2024-04-26T21:36:53.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.283+0000 7f9d81e00640 1 -- 172.21.15.112:0/2788929173 learned_addr learned my addr 172.21.15.112:0/2788929173 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:53.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.283+0000 7f9d81e00640 1 -- 172.21.15.112:0/2788929173 >> v2:172.21.15.5:3300/0 conn(0x7f9d840be7e0 msgr2=0x7f9d8414bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:53.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.283+0000 7f9d81e00640 1 --2- 172.21.15.112:0/2788929173 >> v2:172.21.15.5:3300/0 conn(0x7f9d840be7e0 0x7f9d8414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.283+0000 7f9d81e00640 1 -- 172.21.15.112:0/2788929173 >> v1:172.21.15.5:6789/0 conn(0x7f9d84142660 legacy=0x7f9d840b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:53.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.283+0000 7f9d81e00640 1 -- 172.21.15.112:0/2788929173 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d840b5d80 con 0x7f9d8414c090 2024-04-26T21:36:53.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.284+0000 7f9d81e00640 1 --2- 172.21.15.112:0/2788929173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d84142120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9d84069070 tx=0x7f9d7002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c67af22a499a309 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:53.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.285+0000 7f9d81400640 1 -- 172.21.15.112:0/2788929173 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70037070 con 0x7f9d8414c090 2024-04-26T21:36:53.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.285+0000 7f9d81400640 1 -- 172.21.15.112:0/2788929173 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d70032440 con 0x7f9d8414c090 2024-04-26T21:36:53.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.285+0000 7f9d81400640 1 -- 172.21.15.112:0/2788929173 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70032810 con 0x7f9d8414c090 2024-04-26T21:36:53.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.285+0000 7f9d88a00640 1 -- 172.21.15.112:0/2788929173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 msgr2=0x7f9d84142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.285+0000 7f9d88a00640 1 --2- 172.21.15.112:0/2788929173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d84142120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9d84069070 tx=0x7f9d7002a1a0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.286+0000 7f9d88a00640 1 -- 172.21.15.112:0/2788929173 shutdown_connections 2024-04-26T21:36:53.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.286+0000 7f9d88a00640 1 --2- 172.21.15.112:0/2788929173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d84142120 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.286+0000 7f9d88a00640 1 --2- 172.21.15.112:0/2788929173 >> v2:172.21.15.5:3300/0 conn(0x7f9d840be7e0 0x7f9d8414bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.286+0000 7f9d88a00640 1 -- 172.21.15.112:0/2788929173 >> 172.21.15.112:0/2788929173 conn(0x7f9d840686c0 msgr2=0x7f9d840bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:53.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.286+0000 7f9d88a00640 1 -- 172.21.15.112:0/2788929173 shutdown_connections 2024-04-26T21:36:53.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.286+0000 7f9d88a00640 1 -- 172.21.15.112:0/2788929173 wait complete. 2024-04-26T21:36:53.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.287+0000 7f9d88a00640 1 Processor -- start 2024-04-26T21:36:53.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.287+0000 7f9d88a00640 1 -- start start 2024-04-26T21:36:53.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d88a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d840be7e0 0x7f9d840bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d88a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d84142660 0x7f9d841d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d88a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d841ddf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d88a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9d840ba5e0 con 0x7f9d840be7e0 2024-04-26T21:36:53.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d88a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9d840b6c20 con 0x7f9d8414c090 2024-04-26T21:36:53.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d88a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9d840b78c0 con 0x7f9d84142660 2024-04-26T21:36:53.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d81e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d84142660 0x7f9d841d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d83200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d841ddf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d81e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d84142660 0x7f9d841d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:52008/0 (socket says 172.21.15.112:52008) 2024-04-26T21:36:53.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.288+0000 7f9d81e00640 1 -- 172.21.15.112:0/1787956065 learned_addr learned my addr 172.21.15.112:0/1787956065 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:53.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d82800640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d840be7e0 0x7f9d840bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d81e00640 1 -- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 msgr2=0x7f9d841ddf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d81e00640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d841ddf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d81e00640 1 -- 172.21.15.112:0/1787956065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d840be7e0 msgr2=0x7f9d840bcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d81e00640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d840be7e0 0x7f9d840bcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d81e00640 1 -- 172.21.15.112:0/1787956065 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d841d2470 con 0x7f9d84142660 2024-04-26T21:36:53.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d83200640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d841ddf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:36:53.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.289+0000 7f9d81e00640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d84142660 0x7f9d841d1f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9d70000c00 tx=0x7f9d700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:53.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.290+0000 7f9d7aa00640 1 -- 172.21.15.112:0/1787956065 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70041070 con 0x7f9d84142660 2024-04-26T21:36:53.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.290+0000 7f9d7aa00640 1 -- 172.21.15.112:0/1787956065 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7003c870 con 0x7f9d84142660 2024-04-26T21:36:53.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.290+0000 7f9d7aa00640 1 -- 172.21.15.112:0/1787956065 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70037040 con 0x7f9d84142660 2024-04-26T21:36:53.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.290+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d841448a0 con 0x7f9d84142660 2024-04-26T21:36:53.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.290+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d841d26f0 con 0x7f9d84142660 2024-04-26T21:36:53.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.290+0000 7f9d7aa00640 1 -- 172.21.15.112:0/1787956065 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d70044070 con 0x7f9d84142660 2024-04-26T21:36:53.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.290+0000 7f9d7aa00640 1 -- 172.21.15.112:0/1787956065 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f9d7003d3f0 con 0x7f9d84142660 2024-04-26T21:36:53.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.291+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d84075db0 con 0x7f9d84142660 2024-04-26T21:36:53.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.294+0000 7f9d7aa00640 1 -- 172.21.15.112:0/1787956065 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9d841d2470 con 0x7f9d84142660 2024-04-26T21:36:53.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.381+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "054c9b7f-cfba-42b9-ab0c-8e001c866ec4", "id": 0} v 0) -- 0x7f9d84145f10 con 0x7f9d84142660 2024-04-26T21:36:53.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.387+0000 7f9d7aa00640 1 -- 172.21.15.112:0/1787956065 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "054c9b7f-cfba-42b9-ab0c-8e001c866ec4", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f9d7003cc60 con 0x7f9d84142660 2024-04-26T21:36:53.388 INFO:teuthology.orchestra.run.smithi112.stdout:0 2024-04-26T21:36:53.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d84142660 msgr2=0x7f9d841d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d84142660 0x7f9d841d1f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9d70000c00 tx=0x7f9d700046c0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 shutdown_connections 2024-04-26T21:36:53.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d8414c090 0x7f9d841ddf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9d84142660 0x7f9d841d1f30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 --2- 172.21.15.112:0/1787956065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d840be7e0 0x7f9d840bcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 >> 172.21.15.112:0/1787956065 conn(0x7f9d840686c0 msgr2=0x7f9d840bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:53.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 shutdown_connections 2024-04-26T21:36:53.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.389+0000 7f9d88a00640 1 -- 172.21.15.112:0/1787956065 wait complete. 2024-04-26T21:36:53.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 1ab1bb35-f570-4fcf-a8ab-b0211996a005 1 2024-04-26T21:36:53.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.587+0000 7fd176a00640 1 Processor -- start 2024-04-26T21:36:53.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.588+0000 7fd176a00640 1 -- start start 2024-04-26T21:36:53.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd176a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1700be9b0 0x7fd1700b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd176a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd17014be90 0x7fd17014c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd176a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd17014c840 con 0x7fd170142310 2024-04-26T21:36:53.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd176a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd170142ed0 con 0x7fd1700be9b0 2024-04-26T21:36:53.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd176a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd1700b5d50 con 0x7fd17014be90 2024-04-26T21:36:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd167400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd17014be90 0x7fd17014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd167400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd17014be90 0x7fd17014c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43350/0 (socket says 172.21.15.112:43350) 2024-04-26T21:36:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd174a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd170142310 0x7fd1701427c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38190/0 (socket says 172.21.15.112:38190) 2024-04-26T21:36:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.589+0000 7fd167400640 1 -- 172.21.15.112:0/177830032 learned_addr learned my addr 172.21.15.112:0/177830032 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.590+0000 7fd16fe00640 1 --2- 172.21.15.112:0/177830032 >> v2:172.21.15.5:3300/0 conn(0x7fd1700be9b0 0x7fd1700b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.590+0000 7fd167400640 1 -- 172.21.15.112:0/177830032 >> v2:172.21.15.5:3300/0 conn(0x7fd1700be9b0 msgr2=0x7fd1700b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:53.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.590+0000 7fd167400640 1 --2- 172.21.15.112:0/177830032 >> v2:172.21.15.5:3300/0 conn(0x7fd1700be9b0 0x7fd1700b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.590+0000 7fd167400640 1 -- 172.21.15.112:0/177830032 >> v1:172.21.15.112:6789/0 conn(0x7fd170142310 legacy=0x7fd1701427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.590+0000 7fd167400640 1 -- 172.21.15.112:0/177830032 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1700bed90 con 0x7fd17014be90 2024-04-26T21:36:53.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.590+0000 7fd16f400640 1 -- 172.21.15.112:0/177830032 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500273136 0 0) 0x7fd17014c840 con 0x7fd170142310 2024-04-26T21:36:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.591+0000 7fd167400640 1 --2- 172.21.15.112:0/177830032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd17014be90 0x7fd17014c300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd1700b76f0 tx=0x7fd15802a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12a73812760801a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.591+0000 7fd16f400640 1 -- 172.21.15.112:0/177830032 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158037070 con 0x7fd17014be90 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.591+0000 7fd16f400640 1 -- 172.21.15.112:0/177830032 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158032440 con 0x7fd17014be90 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.591+0000 7fd16f400640 1 -- 172.21.15.112:0/177830032 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158032810 con 0x7fd17014be90 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 -- 172.21.15.112:0/177830032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd17014be90 msgr2=0x7fd17014c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 --2- 172.21.15.112:0/177830032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd17014be90 0x7fd17014c300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd1700b76f0 tx=0x7fd15802a150 comp rx=0 tx=0).stop 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 -- 172.21.15.112:0/177830032 shutdown_connections 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 --2- 172.21.15.112:0/177830032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd17014be90 0x7fd17014c300 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 --2- 172.21.15.112:0/177830032 >> v2:172.21.15.5:3300/0 conn(0x7fd1700be9b0 0x7fd1700b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 -- 172.21.15.112:0/177830032 >> 172.21.15.112:0/177830032 conn(0x7fd1700687a0 msgr2=0x7fd1700be030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 -- 172.21.15.112:0/177830032 shutdown_connections 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.592+0000 7fd176a00640 1 -- 172.21.15.112:0/177830032 wait complete. 2024-04-26T21:36:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.594+0000 7fd176a00640 1 Processor -- start 2024-04-26T21:36:53.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.594+0000 7fd176a00640 1 -- start start 2024-04-26T21:36:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd176a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1700be9b0 0x7fd17013a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd176a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd170142310 0x7fd17014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd176a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17014be90 0x7fd170134d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd176a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1700b65b0 con 0x7fd17014be90 2024-04-26T21:36:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd176a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd1700b62d0 con 0x7fd170142310 2024-04-26T21:36:53.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd176a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd1700b5990 con 0x7fd1700be9b0 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd16fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1700be9b0 0x7fd17013a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd167400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd170142310 0x7fd17014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd16fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1700be9b0 0x7fd17013a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:52016/0 (socket says 172.21.15.112:52016) 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd16fe00640 1 -- 172.21.15.112:0/3609821717 learned_addr learned my addr 172.21.15.112:0/3609821717 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.595+0000 7fd174a00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17014be90 0x7fd170134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16fe00640 1 -- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd170142310 msgr2=0x7fd17014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16fe00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd170142310 0x7fd17014b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16fe00640 1 -- 172.21.15.112:0/3609821717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17014be90 msgr2=0x7fd170134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16fe00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17014be90 0x7fd170134d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16fe00640 1 -- 172.21.15.112:0/3609821717 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd170144cd0 con 0x7fd1700be9b0 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd167400640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd170142310 0x7fd17014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd174a00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17014be90 0x7fd170134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16fe00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1700be9b0 0x7fd17013a640 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd160007ef0 tx=0x7fd16000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:53.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16cc00640 1 -- 172.21.15.112:0/3609821717 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160014620 con 0x7fd1700be9b0 2024-04-26T21:36:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16cc00640 1 -- 172.21.15.112:0/3609821717 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd160019070 con 0x7fd1700be9b0 2024-04-26T21:36:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd170145220 con 0x7fd1700be9b0 2024-04-26T21:36:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd16cc00640 1 -- 172.21.15.112:0/3609821717 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160014a00 con 0x7fd1700be9b0 2024-04-26T21:36:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.596+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd170145e40 con 0x7fd1700be9b0 2024-04-26T21:36:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.597+0000 7fd16cc00640 1 -- 172.21.15.112:0/3609821717 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd160014ba0 con 0x7fd1700be9b0 2024-04-26T21:36:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.597+0000 7fd16cc00640 1 -- 172.21.15.112:0/3609821717 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd16001d3c0 con 0x7fd1700be9b0 2024-04-26T21:36:53.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.597+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd170075db0 con 0x7fd1700be9b0 2024-04-26T21:36:53.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.602+0000 7fd16cc00640 1 -- 172.21.15.112:0/3609821717 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd16001e460 con 0x7fd1700be9b0 2024-04-26T21:36:53.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.681+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1ab1bb35-f570-4fcf-a8ab-b0211996a005", "id": 1} v 0) -- 0x7fd170144f40 con 0x7fd1700be9b0 2024-04-26T21:36:53.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.685+0000 7fd16cc00640 1 -- 172.21.15.112:0/3609821717 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ab1bb35-f570-4fcf-a8ab-b0211996a005", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd16001e640 con 0x7fd1700be9b0 2024-04-26T21:36:53.686 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-04-26T21:36:53.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.686+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1700be9b0 msgr2=0x7fd17013a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.686+0000 7fd176a00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1700be9b0 0x7fd17013a640 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd160007ef0 tx=0x7fd16000e4b0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.687+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 shutdown_connections 2024-04-26T21:36:53.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.687+0000 7fd176a00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17014be90 0x7fd170134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.687+0000 7fd176a00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd170142310 0x7fd17014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.687+0000 7fd176a00640 1 --2- 172.21.15.112:0/3609821717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1700be9b0 0x7fd17013a640 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.687+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 >> 172.21.15.112:0/3609821717 conn(0x7fd1700687a0 msgr2=0x7fd1700be010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:53.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.687+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 shutdown_connections 2024-04-26T21:36:53.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.687+0000 7fd176a00640 1 -- 172.21.15.112:0/3609821717 wait complete. 2024-04-26T21:36:53.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new cd21fc58-f743-42ab-9031-65f2a0f6f68d 2 2024-04-26T21:36:53.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.861+0000 7fb1c3e00640 1 Processor -- start 2024-04-26T21:36:53.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.861+0000 7fb1c3e00640 1 -- start start 2024-04-26T21:36:53.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c40be7e0 0x7fb1c414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb1c414c090 0x7fb1c4142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c414c4f0 con 0x7fb1c4142660 2024-04-26T21:36:53.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40bebc0 con 0x7fb1c414c090 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40b7cf0 con 0x7fb1c40be7e0 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c40be7e0 0x7fb1c414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c40be7e0 0x7fb1c414bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:52018/0 (socket says 172.21.15.112:52018) 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c3400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb1c4142660 0x7fb1c40b87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38204/0 (socket says 172.21.15.112:38204) 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c2a00640 1 -- 172.21.15.112:0/1892377048 learned_addr learned my addr 172.21.15.112:0/1892377048 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.862+0000 7fb1c2000640 1 --2- 172.21.15.112:0/1892377048 >> v2:172.21.15.112:3300/0 conn(0x7fb1c414c090 0x7fb1c4142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.863+0000 7fb1c2a00640 1 -- 172.21.15.112:0/1892377048 >> v2:172.21.15.112:3300/0 conn(0x7fb1c414c090 msgr2=0x7fb1c4142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.863+0000 7fb1c2a00640 1 --2- 172.21.15.112:0/1892377048 >> v2:172.21.15.112:3300/0 conn(0x7fb1c414c090 0x7fb1c4142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.863+0000 7fb1c2a00640 1 -- 172.21.15.112:0/1892377048 >> v1:172.21.15.112:6789/0 conn(0x7fb1c4142660 legacy=0x7fb1c40b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.863+0000 7fb1c2a00640 1 -- 172.21.15.112:0/1892377048 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40b5d80 con 0x7fb1c40be7e0 2024-04-26T21:36:53.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.863+0000 7fb1c1600640 1 -- 172.21.15.112:0/1892377048 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343469692 0 0) 0x7fb1c414c4f0 con 0x7fb1c4142660 2024-04-26T21:36:53.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.864+0000 7fb1c2a00640 1 --2- 172.21.15.112:0/1892377048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c40be7e0 0x7fb1c414bb50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009870 tx=0x7fb1b402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=763b3c4bfcfc137d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:53.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.864+0000 7fb1c1600640 1 -- 172.21.15.112:0/1892377048 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4037070 con 0x7fb1c40be7e0 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.864+0000 7fb1c1600640 1 -- 172.21.15.112:0/1892377048 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b4032440 con 0x7fb1c40be7e0 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.864+0000 7fb1c1600640 1 -- 172.21.15.112:0/1892377048 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4032810 con 0x7fb1c40be7e0 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 -- 172.21.15.112:0/1892377048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c40be7e0 msgr2=0x7fb1c414bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 --2- 172.21.15.112:0/1892377048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c40be7e0 0x7fb1c414bb50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009870 tx=0x7fb1b402a1c0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 -- 172.21.15.112:0/1892377048 shutdown_connections 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 --2- 172.21.15.112:0/1892377048 >> v2:172.21.15.112:3300/0 conn(0x7fb1c414c090 0x7fb1c4142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 --2- 172.21.15.112:0/1892377048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c40be7e0 0x7fb1c414bb50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 -- 172.21.15.112:0/1892377048 >> 172.21.15.112:0/1892377048 conn(0x7fb1c40686c0 msgr2=0x7fb1c40bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 -- 172.21.15.112:0/1892377048 shutdown_connections 2024-04-26T21:36:53.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.865+0000 7fb1c3e00640 1 -- 172.21.15.112:0/1892377048 wait complete. 2024-04-26T21:36:53.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.866+0000 7fb1c3e00640 1 Processor -- start 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.867+0000 7fb1c3e00640 1 -- start start 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.867+0000 7fb1c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c40be7e0 0x7fb1c4143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.867+0000 7fb1c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4142660 0x7fb1c4143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.867+0000 7fb1c3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c414c090 0x7fb1c41de740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.867+0000 7fb1c3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40ba5e0 con 0x7fb1c4142660 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.867+0000 7fb1c3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40b6c20 con 0x7fb1c40be7e0 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.867+0000 7fb1c3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40b78c0 con 0x7fb1c414c090 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c40be7e0 0x7fb1c4143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c3400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c414c090 0x7fb1c41de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c40be7e0 0x7fb1c4143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43376/0 (socket says 172.21.15.112:43376) 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 -- 172.21.15.112:0/575693044 learned_addr learned my addr 172.21.15.112:0/575693044 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2000640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4142660 0x7fb1c4143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 -- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c414c090 msgr2=0x7fb1c41de740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c414c090 0x7fb1c41de740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 -- 172.21.15.112:0/575693044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4142660 msgr2=0x7fb1c4143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4142660 0x7fb1c4143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 -- 172.21.15.112:0/575693044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c4145700 con 0x7fb1c40be7e0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c3400640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c414c090 0x7fb1c41de740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.868+0000 7fb1c2a00640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c40be7e0 0x7fb1c4143c50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.869+0000 7fb1baa00640 1 -- 172.21.15.112:0/575693044 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4037040 con 0x7fb1c40be7e0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.869+0000 7fb1baa00640 1 -- 172.21.15.112:0/575693044 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b4042070 con 0x7fb1c40be7e0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.869+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c40bd500 con 0x7fb1c40be7e0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.869+0000 7fb1baa00640 1 -- 172.21.15.112:0/575693044 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4030880 con 0x7fb1c40be7e0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.869+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c40bda80 con 0x7fb1c40be7e0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.869+0000 7fb1baa00640 1 -- 172.21.15.112:0/575693044 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb1b402ad10 con 0x7fb1c40be7e0 2024-04-26T21:36:53.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.869+0000 7fb1baa00640 1 -- 172.21.15.112:0/575693044 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb1b4047870 con 0x7fb1c40be7e0 2024-04-26T21:36:53.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.870+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c40b9d90 con 0x7fb1c40be7e0 2024-04-26T21:36:53.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.873+0000 7fb1baa00640 1 -- 172.21.15.112:0/575693044 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb1c40b9d90 con 0x7fb1c40be7e0 2024-04-26T21:36:53.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.948+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd21fc58-f743-42ab-9031-65f2a0f6f68d", "id": 2} v 0) -- 0x7fb1c4145f10 con 0x7fb1c40be7e0 2024-04-26T21:36:53.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.954+0000 7fb1baa00640 1 -- 172.21.15.112:0/575693044 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd21fc58-f743-42ab-9031-65f2a0f6f68d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb1b4047460 con 0x7fb1c40be7e0 2024-04-26T21:36:53.955 INFO:teuthology.orchestra.run.smithi112.stdout:2 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c40be7e0 msgr2=0x7fb1c4143c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c40be7e0 0x7fb1c4143c50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b40046c0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 shutdown_connections 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1c414c090 0x7fb1c41de740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4142660 0x7fb1c4143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 --2- 172.21.15.112:0/575693044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c40be7e0 0x7fb1c4143c50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 >> 172.21.15.112:0/575693044 conn(0x7fb1c40686c0 msgr2=0x7fb1c4148df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 shutdown_connections 2024-04-26T21:36:53.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:53.955+0000 7fb1c3e00640 1 -- 172.21.15.112:0/575693044 wait complete. 2024-04-26T21:36:53.972 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa 3 2024-04-26T21:36:54.152 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:54.151+0000 7f108d5b6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T21:36:54.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.152+0000 7fa451e00640 1 Processor -- start 2024-04-26T21:36:54.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.152+0000 7fa451e00640 1 -- start start 2024-04-26T21:36:54.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.153+0000 7fa451e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa44c14c1a0 0x7fa44c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.153+0000 7fa451e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa44c0b1850 con 0x7fa44c0be900 2024-04-26T21:36:54.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.153+0000 7fa451e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa44c0bece0 con 0x7fa44c14bd60 2024-04-26T21:36:54.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.153+0000 7fa451e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa44c0b66b0 con 0x7fa44c14c1a0 2024-04-26T21:36:54.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa44a000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa44c14bd60 0x7fa44c1510a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38208/0 (socket says 172.21.15.112:38208) 2024-04-26T21:36:54.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa44a000640 1 -- 172.21.15.112:0/162106677 learned_addr learned my addr 172.21.15.112:0/162106677 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:36:54.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa44b400640 1 --2- 172.21.15.112:0/162106677 >> v2:172.21.15.112:3300/0 conn(0x7fa44c14c1a0 0x7fa44c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa449600640 1 -- 172.21.15.112:0/162106677 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162576632 0 0) 0x7fa44c0bece0 con 0x7fa44c14bd60 2024-04-26T21:36:54.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa449600640 1 -- 172.21.15.112:0/162106677 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa430003520 con 0x7fa44c14bd60 2024-04-26T21:36:54.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa44b400640 1 -- 172.21.15.112:0/162106677 >> v1:172.21.15.112:6789/0 conn(0x7fa44c14bd60 legacy=0x7fa44c1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa44b400640 1 -- 172.21.15.112:0/162106677 >> v1:172.21.15.5:6789/0 conn(0x7fa44c0be900 legacy=0x7fa44c1427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.154+0000 7fa44b400640 1 -- 172.21.15.112:0/162106677 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c14c630 con 0x7fa44c14c1a0 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.155+0000 7fa44b400640 1 --2- 172.21.15.112:0/162106677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 0x7fa44c1547d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa444009d90 tx=0x7fa44402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2588b695d24d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa449600640 1 -- 172.21.15.112:0/162106677 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444031600 con 0x7fa44c14c1a0 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa449600640 1 -- 172.21.15.112:0/162106677 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4440317a0 con 0x7fa44c14c1a0 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa449600640 1 -- 172.21.15.112:0/162106677 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444031b70 con 0x7fa44c14c1a0 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa451e00640 1 -- 172.21.15.112:0/162106677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 msgr2=0x7fa44c1547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa451e00640 1 --2- 172.21.15.112:0/162106677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 0x7fa44c1547d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa444009d90 tx=0x7fa44402a5d0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa451e00640 1 -- 172.21.15.112:0/162106677 shutdown_connections 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa451e00640 1 --2- 172.21.15.112:0/162106677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 0x7fa44c1547d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa451e00640 1 -- 172.21.15.112:0/162106677 >> 172.21.15.112:0/162106677 conn(0x7fa44c0686c0 msgr2=0x7fa44c0bdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa451e00640 1 -- 172.21.15.112:0/162106677 shutdown_connections 2024-04-26T21:36:54.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.156+0000 7fa451e00640 1 -- 172.21.15.112:0/162106677 wait complete. 2024-04-26T21:36:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.158+0000 7fa451e00640 1 Processor -- start 2024-04-26T21:36:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.158+0000 7fa451e00640 1 -- start start 2024-04-26T21:36:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa451e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa44c0be900 0x7fa44c1e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa451e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44c14bd60 0x7fa44c14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa451e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 0x7fa44c148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa451e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c142ec0 con 0x7fa44c0be900 2024-04-26T21:36:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa451e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c0b6c70 con 0x7fa44c14c1a0 2024-04-26T21:36:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa451e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa44c0b5380 con 0x7fa44c14bd60 2024-04-26T21:36:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa44a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44c14bd60 0x7fa44c14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa44b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 0x7fa44c148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa44a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44c14bd60 0x7fa44c14ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:52036/0 (socket says 172.21.15.112:52036) 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa44a000640 1 -- 172.21.15.112:0/2992176031 learned_addr learned my addr 172.21.15.112:0/2992176031 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.159+0000 7fa44aa00640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa44c0be900 0x7fa44c1e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa44a000640 1 -- 172.21.15.112:0/2992176031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 msgr2=0x7fa44c148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa44a000640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 0x7fa44c148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa44a000640 1 -- 172.21.15.112:0/2992176031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa44c0be900 msgr2=0x7fa44c1e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa44a000640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa44c0be900 0x7fa44c1e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa44a000640 1 -- 172.21.15.112:0/2992176031 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c0b2fc0 con 0x7fa44c14bd60 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa44a000640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44c14bd60 0x7fa44c14ae20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c410 tx=0x7fa43800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa443400640 1 -- 172.21.15.112:0/2992176031 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438017070 con 0x7fa44c14bd60 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa443400640 1 -- 172.21.15.112:0/2992176031 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa438005ce0 con 0x7fa44c14bd60 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa443400640 1 -- 172.21.15.112:0/2992176031 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4380072f0 con 0x7fa44c14bd60 2024-04-26T21:36:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44c14b9c0 con 0x7fa44c14bd60 2024-04-26T21:36:54.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.160+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44c148110 con 0x7fa44c14bd60 2024-04-26T21:36:54.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.161+0000 7fa443400640 1 -- 172.21.15.112:0/2992176031 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa43801a070 con 0x7fa44c14bd60 2024-04-26T21:36:54.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.161+0000 7fa443400640 1 -- 172.21.15.112:0/2992176031 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa438012890 con 0x7fa44c14bd60 2024-04-26T21:36:54.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.161+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa44c0ba1d0 con 0x7fa44c14bd60 2024-04-26T21:36:54.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.164+0000 7fa443400640 1 -- 172.21.15.112:0/2992176031 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa44c0ba1d0 con 0x7fa44c14bd60 2024-04-26T21:36:54.202 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:54.202+0000 7febf160f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T21:36:54.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.245+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa", "id": 3} v 0) -- 0x7fa44c075db0 con 0x7fa44c14bd60 2024-04-26T21:36:54.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.251+0000 7fa443400640 1 -- 172.21.15.112:0/2992176031 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa438021070 con 0x7fa44c14bd60 2024-04-26T21:36:54.252 INFO:teuthology.orchestra.run.smithi112.stdout:3 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44c14bd60 msgr2=0x7fa44c14ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44c14bd60 0x7fa44c14ae20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c410 tx=0x7fa43800c8d0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 shutdown_connections 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44c14c1a0 0x7fa44c148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44c14bd60 0x7fa44c14ae20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 --2- 172.21.15.112:0/2992176031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa44c0be900 0x7fa44c1e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 >> 172.21.15.112:0/2992176031 conn(0x7fa44c0686c0 msgr2=0x7fa44c142580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.252+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 shutdown_connections 2024-04-26T21:36:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.253+0000 7fa451e00640 1 -- 172.21.15.112:0/2992176031 wait complete. 2024-04-26T21:36:54.265 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:54.264+0000 7f108d5b6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T21:36:54.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 4c0527e4-7a0c-42a2-954f-d141bcf0b003 4 2024-04-26T21:36:54.313 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:54.313+0000 7febf160f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T21:36:54.318 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:54.318+0000 7f108d5b6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T21:36:54.365 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:54.365+0000 7febf160f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T21:36:54.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.442+0000 7f6ecb200640 1 Processor -- start 2024-04-26T21:36:54.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.442+0000 7f6ecb200640 1 -- start start 2024-04-26T21:36:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.443+0000 7f6ecb200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ecc148fd0 0x7f6ecc0b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.443+0000 7f6ecb200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ecc1421a0 0x7f6ecc1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.443+0000 7f6ecb200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ecc0b6d90 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.443+0000 7f6ecb200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6ecc1487d0 con 0x7f6ecc148fd0 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.443+0000 7f6ecb200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ecc148ab0 con 0x7f6ecc1421a0 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6ec9e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6ecc0b69b0 0x7f6ecc0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38212/0 (socket says 172.21.15.112:38212) 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6eca800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ecc1421a0 0x7f6ecc1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6ec9e00640 1 -- 172.21.15.112:0/579147362 learned_addr learned my addr 172.21.15.112:0/579147362 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6ec9400640 1 --2- 172.21.15.112:0/579147362 >> v2:172.21.15.5:3300/0 conn(0x7f6ecc148fd0 0x7f6ecc0b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6eca800640 1 -- 172.21.15.112:0/579147362 >> v2:172.21.15.5:3300/0 conn(0x7f6ecc148fd0 msgr2=0x7f6ecc0b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6eca800640 1 --2- 172.21.15.112:0/579147362 >> v2:172.21.15.5:3300/0 conn(0x7f6ecc148fd0 0x7f6ecc0b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6ec8a00640 1 -- 172.21.15.112:0/579147362 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470721833 0 0) 0x7f6ecc0b6d90 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6eca800640 1 -- 172.21.15.112:0/579147362 >> v1:172.21.15.112:6789/0 conn(0x7f6ecc0b69b0 legacy=0x7f6ecc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.444+0000 7f6eca800640 1 -- 172.21.15.112:0/579147362 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ecc1484a0 con 0x7f6ecc1421a0 2024-04-26T21:36:54.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.445+0000 7f6eca800640 1 --2- 172.21.15.112:0/579147362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc1421a0 0x7f6ecc1425d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc06c400 tx=0x7f6ec402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b31303947e723bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:54.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.445+0000 7f6ec8a00640 1 -- 172.21.15.112:0/579147362 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4007740 con 0x7f6ecc1421a0 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.445+0000 7f6ec8a00640 1 -- 172.21.15.112:0/579147362 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec40078e0 con 0x7f6ecc1421a0 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.445+0000 7f6ec8a00640 1 -- 172.21.15.112:0/579147362 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4007cb0 con 0x7f6ecc1421a0 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 -- 172.21.15.112:0/579147362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc1421a0 msgr2=0x7f6ecc1425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 --2- 172.21.15.112:0/579147362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc1421a0 0x7f6ecc1425d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc06c400 tx=0x7f6ec402a680 comp rx=0 tx=0).stop 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 -- 172.21.15.112:0/579147362 shutdown_connections 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 --2- 172.21.15.112:0/579147362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc1421a0 0x7f6ecc1425d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 --2- 172.21.15.112:0/579147362 >> v2:172.21.15.5:3300/0 conn(0x7f6ecc148fd0 0x7f6ecc0b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 -- 172.21.15.112:0/579147362 >> 172.21.15.112:0/579147362 conn(0x7f6ecc0bde50 msgr2=0x7f6ecc0be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 -- 172.21.15.112:0/579147362 shutdown_connections 2024-04-26T21:36:54.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.446+0000 7f6ecb200640 1 -- 172.21.15.112:0/579147362 wait complete. 2024-04-26T21:36:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.447+0000 7f6ecb200640 1 Processor -- start 2024-04-26T21:36:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.448+0000 7f6ecb200640 1 -- start start 2024-04-26T21:36:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.448+0000 7f6ecb200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ecc0b69b0 0x7f6ecc144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.448+0000 7f6ecb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ecc1421a0 0x7f6ecc13e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.448+0000 7f6ecb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc148fd0 0x7f6ecc13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.448+0000 7f6ecb200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc0ba720 con 0x7f6ecc1421a0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.448+0000 7f6ecb200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc0ba5a0 con 0x7f6ecc148fd0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.448+0000 7f6ecb200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6ecc152e20 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ecc0b69b0 0x7f6ecc144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ecc0b69b0 0x7f6ecc144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:52048/0 (socket says 172.21.15.112:52048) 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6eca800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc148fd0 0x7f6ecc13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 -- 172.21.15.112:0/1135549862 learned_addr learned my addr 172.21.15.112:0/1135549862 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9400640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ecc1421a0 0x7f6ecc13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 -- 172.21.15.112:0/1135549862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc148fd0 msgr2=0x7f6ecc13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc148fd0 0x7f6ecc13eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 -- 172.21.15.112:0/1135549862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ecc1421a0 msgr2=0x7f6ecc13e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ecc1421a0 0x7f6ecc13e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 -- 172.21.15.112:0/1135549862 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ecc140090 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.449+0000 7f6ec9e00640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ecc0b69b0 0x7f6ecc144ee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00c4d0 tx=0x7f6ebc00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.450+0000 7f6ec2000640 1 -- 172.21.15.112:0/1135549862 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc018070 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.450+0000 7f6ec2000640 1 -- 172.21.15.112:0/1135549862 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc007500 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.450+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ecc13d5e0 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.450+0000 7f6ec2000640 1 -- 172.21.15.112:0/1135549862 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc004a20 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.450+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ecc13e1e0 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.450+0000 7f6ec2000640 1 -- 172.21.15.112:0/1135549862 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ebc01b070 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.450+0000 7f6ec2000640 1 -- 172.21.15.112:0/1135549862 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6ebc004bc0 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.451+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ecc075db0 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.453+0000 7f6ec2000640 1 -- 172.21.15.112:0/1135549862 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6ebc01d440 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.525 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:54.525+0000 7f108d5b6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T21:36:54.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.532+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c0527e4-7a0c-42a2-954f-d141bcf0b003", "id": 4} v 0) -- 0x7f6ecc069700 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.538+0000 7f6ec2000640 1 -- 172.21.15.112:0/1135549862 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c0527e4-7a0c-42a2-954f-d141bcf0b003", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6ebc01d620 con 0x7f6ecc0b69b0 2024-04-26T21:36:54.538 INFO:teuthology.orchestra.run.smithi112.stdout:4 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ecc0b69b0 msgr2=0x7f6ecc144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ecc0b69b0 0x7f6ecc144ee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00c4d0 tx=0x7f6ebc00c990 comp rx=0 tx=0).stop 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 shutdown_connections 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ecc148fd0 0x7f6ecc13eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ecc1421a0 0x7f6ecc13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 --2- 172.21.15.112:0/1135549862 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6ecc0b69b0 0x7f6ecc144ee0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 >> 172.21.15.112:0/1135549862 conn(0x7f6ecc0bde50 msgr2=0x7f6ecc147220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 shutdown_connections 2024-04-26T21:36:54.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.539+0000 7f6ecb200640 1 -- 172.21.15.112:0/1135549862 wait complete. 2024-04-26T21:36:54.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new c023e884-9675-48b7-be60-b237c3109def 5 2024-04-26T21:36:54.566 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:54.566+0000 7febf160f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T21:36:54.585 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:54.585+0000 7f108d5b6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T21:36:54.640 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:54.640+0000 7febf160f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T21:36:54.650 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:54.649+0000 7f108d5b6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T21:36:54.705 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:54.704+0000 7febf160f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T21:36:54.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.718+0000 7f74efe00640 1 Processor -- start 2024-04-26T21:36:54.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.718+0000 7f74efe00640 1 -- start start 2024-04-26T21:36:54.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.719+0000 7f74efe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f00be7e0 0x7f74f014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74efe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f74f014c090 0x7f74f0142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74efe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f014c4f0 con 0x7f74f0142660 2024-04-26T21:36:54.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74efe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f74f00bebc0 con 0x7f74f014c090 2024-04-26T21:36:54.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74efe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00b7cf0 con 0x7f74f00be7e0 2024-04-26T21:36:54.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74eea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f00be7e0 0x7f74f014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74ee000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f74f014c090 0x7f74f0142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74eea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f00be7e0 0x7f74f014bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:52050/0 (socket says 172.21.15.112:52050) 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74eea00640 1 -- 172.21.15.112:0/516779785 learned_addr learned my addr 172.21.15.112:0/516779785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74ef400640 1 --1- 172.21.15.112:0/516779785 >> v1:172.21.15.112:6789/0 conn(0x7f74f0142660 0x7f74f00b87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38226/0 (socket says 172.21.15.112:38226) 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74eea00640 1 -- 172.21.15.112:0/516779785 >> v2:172.21.15.112:3300/0 conn(0x7f74f014c090 msgr2=0x7f74f0142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74eea00640 1 --2- 172.21.15.112:0/516779785 >> v2:172.21.15.112:3300/0 conn(0x7f74f014c090 0x7f74f0142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.720+0000 7f74eea00640 1 -- 172.21.15.112:0/516779785 >> v1:172.21.15.112:6789/0 conn(0x7f74f0142660 legacy=0x7f74f00b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.721+0000 7f74eea00640 1 -- 172.21.15.112:0/516779785 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f00b5d80 con 0x7f74f00be7e0 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.721+0000 7f74eea00640 1 --2- 172.21.15.112:0/516779785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f00be7e0 0x7f74f014bb50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009870 tx=0x7f74e002a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27008c028dce6b87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74ed600640 1 -- 172.21.15.112:0/516779785 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0037070 con 0x7f74f00be7e0 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74ed600640 1 -- 172.21.15.112:0/516779785 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e002ad60 con 0x7f74f00be7e0 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74ed600640 1 -- 172.21.15.112:0/516779785 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0032660 con 0x7f74f00be7e0 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74efe00640 1 -- 172.21.15.112:0/516779785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f00be7e0 msgr2=0x7f74f014bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74efe00640 1 --2- 172.21.15.112:0/516779785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f00be7e0 0x7f74f014bb50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009870 tx=0x7f74e002a0d0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74efe00640 1 -- 172.21.15.112:0/516779785 shutdown_connections 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74efe00640 1 --2- 172.21.15.112:0/516779785 >> v2:172.21.15.112:3300/0 conn(0x7f74f014c090 0x7f74f0142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74efe00640 1 --2- 172.21.15.112:0/516779785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f00be7e0 0x7f74f014bb50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.722+0000 7f74efe00640 1 -- 172.21.15.112:0/516779785 >> 172.21.15.112:0/516779785 conn(0x7f74f00686c0 msgr2=0x7f74f00bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:54.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.723+0000 7f74efe00640 1 -- 172.21.15.112:0/516779785 shutdown_connections 2024-04-26T21:36:54.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.723+0000 7f74efe00640 1 -- 172.21.15.112:0/516779785 wait complete. 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.724+0000 7f74efe00640 1 Processor -- start 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.724+0000 7f74efe00640 1 -- start start 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74efe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f00be7e0 0x7f74f0143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74efe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f0142660 0x7f74f01ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014c090 0x7f74f013cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74efe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00ba5e0 con 0x7f74f014c090 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74efe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00b6c20 con 0x7f74f00be7e0 2024-04-26T21:36:54.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74efe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00b78c0 con 0x7f74f0142660 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74eea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f00be7e0 0x7f74f0143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74ee000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f0142660 0x7f74f01ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74ee000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f0142660 0x7f74f01ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:52060/0 (socket says 172.21.15.112:52060) 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.725+0000 7f74ee000640 1 -- 172.21.15.112:0/2942762322 learned_addr learned my addr 172.21.15.112:0/2942762322 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74ef400640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014c090 0x7f74f013cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74ee000640 1 -- 172.21.15.112:0/2942762322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f00be7e0 msgr2=0x7f74f0143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74ee000640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f00be7e0 0x7f74f0143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74ee000640 1 -- 172.21.15.112:0/2942762322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014c090 msgr2=0x7f74f013cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74ee000640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014c090 0x7f74f013cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74ee000640 1 -- 172.21.15.112:0/2942762322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f0144510 con 0x7f74f0142660 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74ee000640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f0142660 0x7f74f01ddf90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00e870 tx=0x7f74dc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74e6a00640 1 -- 172.21.15.112:0/2942762322 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc017070 con 0x7f74f0142660 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74e6a00640 1 -- 172.21.15.112:0/2942762322 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74dc00c940 con 0x7f74f0142660 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74e6a00640 1 -- 172.21.15.112:0/2942762322 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00cd30 con 0x7f74f0142660 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f01d41b0 con 0x7f74f0142660 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.726+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f01d2f90 con 0x7f74f0142660 2024-04-26T21:36:54.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.727+0000 7f74e6a00640 1 -- 172.21.15.112:0/2942762322 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f74dc01a070 con 0x7f74f0142660 2024-04-26T21:36:54.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.727+0000 7f74e6a00640 1 -- 172.21.15.112:0/2942762322 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f74dc0064d0 con 0x7f74f0142660 2024-04-26T21:36:54.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.727+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f0141820 con 0x7f74f0142660 2024-04-26T21:36:54.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.730+0000 7f74e6a00640 1 -- 172.21.15.112:0/2942762322 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f74f0141820 con 0x7f74f0142660 2024-04-26T21:36:54.783 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:54.782+0000 7f108d5b6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:36:54.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.808+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c023e884-9675-48b7-be60-b237c3109def", "id": 5} v 0) -- 0x7f74f0075db0 con 0x7f74f0142660 2024-04-26T21:36:54.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.813+0000 7f74e6a00640 1 -- 172.21.15.112:0/2942762322 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c023e884-9675-48b7-be60-b237c3109def", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f74dc0067b0 con 0x7f74f0142660 2024-04-26T21:36:54.814 INFO:teuthology.orchestra.run.smithi112.stdout:5 2024-04-26T21:36:54.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f0142660 msgr2=0x7f74f01ddf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f0142660 0x7f74f01ddf90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00e870 tx=0x7f74dc00ed30 comp rx=0 tx=0).stop 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 shutdown_connections 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74f014c090 0x7f74f013cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74f0142660 0x7f74f01ddf90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 --2- 172.21.15.112:0/2942762322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74f00be7e0 0x7f74f0143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 >> 172.21.15.112:0/2942762322 conn(0x7f74f00686c0 msgr2=0x7f74f0140440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 shutdown_connections 2024-04-26T21:36:54.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:54.815+0000 7f74efe00640 1 -- 172.21.15.112:0/2942762322 wait complete. 2024-04-26T21:36:54.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 42de0ad9-495e-40ee-9e2f-62d902f26a01 6 2024-04-26T21:36:54.839 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:54.838+0000 7febf160f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:36:55.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.054+0000 7f8784e00640 1 Processor -- start 2024-04-26T21:36:55.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.054+0000 7f8784e00640 1 -- start start 2024-04-26T21:36:55.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.055+0000 7f8784e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87800be7e0 0x7f878014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f8784e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878014c520 con 0x7f878014c090 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f8784e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800bebc0 con 0x7f8780142830 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f8784e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f87800b7cf0 con 0x7f87800be7e0 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f877f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f87800be7e0 0x7f878014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f877fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8780142830 0x7f8780152e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38230/0 (socket says 172.21.15.112:38230) 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f877fe00640 1 -- 172.21.15.112:0/2631743464 learned_addr learned my addr 172.21.15.112:0/2631743464 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f877f400640 1 -- 172.21.15.112:0/2631743464 >> v1:172.21.15.112:6789/0 conn(0x7f8780142830 legacy=0x7f8780152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f877f400640 1 -- 172.21.15.112:0/2631743464 >> v1:172.21.15.5:6789/0 conn(0x7f878014c090 legacy=0x7f8780142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f877e000640 1 -- 172.21.15.112:0/2631743464 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731824212 0 0) 0x7f87800bebc0 con 0x7f8780142830 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.056+0000 7f877f400640 1 -- 172.21.15.112:0/2631743464 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87800b5d80 con 0x7f87800be7e0 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.057+0000 7f877f400640 1 --2- 172.21.15.112:0/2631743464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f878014bb50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f877002a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0236b264a38348 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.057+0000 7f877e000640 1 -- 172.21.15.112:0/2631743464 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770037070 con 0x7f87800be7e0 2024-04-26T21:36:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.057+0000 7f877e000640 1 -- 172.21.15.112:0/2631743464 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877002ae50 con 0x7f87800be7e0 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.057+0000 7f877e000640 1 -- 172.21.15.112:0/2631743464 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770032660 con 0x7f87800be7e0 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.058+0000 7f8784e00640 1 -- 172.21.15.112:0/2631743464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 msgr2=0x7f878014bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.058+0000 7f8784e00640 1 --2- 172.21.15.112:0/2631743464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f878014bb50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f877002a140 comp rx=0 tx=0).stop 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.058+0000 7f8784e00640 1 -- 172.21.15.112:0/2631743464 shutdown_connections 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.058+0000 7f8784e00640 1 --2- 172.21.15.112:0/2631743464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f878014bb50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.058+0000 7f8784e00640 1 -- 172.21.15.112:0/2631743464 >> 172.21.15.112:0/2631743464 conn(0x7f87800686c0 msgr2=0x7f87800bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.058+0000 7f8784e00640 1 -- 172.21.15.112:0/2631743464 shutdown_connections 2024-04-26T21:36:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.058+0000 7f8784e00640 1 -- 172.21.15.112:0/2631743464 wait complete. 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.060+0000 7f8784e00640 1 Processor -- start 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.060+0000 7f8784e00640 1 -- start start 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f8784e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f87801d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f8784e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780142830 0x7f87801d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f8784e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f878014c090 0x7f87801d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f8784e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87800ba5e0 con 0x7f8780142830 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f8784e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f87800b6c20 con 0x7f87800be7e0 2024-04-26T21:36:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f8784e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f87800b78c0 con 0x7f878014c090 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f87801d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f878014c090 0x7f87801d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f87801d3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43430/0 (socket says 172.21.15.112:43430) 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 -- 172.21.15.112:0/11919075 learned_addr learned my addr 172.21.15.112:0/11919075 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877ea00640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780142830 0x7f87801d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 -- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f878014c090 msgr2=0x7f87801d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f878014c090 0x7f87801d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 -- 172.21.15.112:0/11919075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780142830 msgr2=0x7f87801d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780142830 0x7f87801d4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877f400640 1 -- 172.21.15.112:0/11919075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780145160 con 0x7f87800be7e0 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.061+0000 7f877fe00640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f878014c090 0x7f87801d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:36:55.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.062+0000 7f877f400640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f87801d3ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f87700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:55.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.062+0000 7f8777400640 1 -- 172.21.15.112:0/11919075 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770042070 con 0x7f87800be7e0 2024-04-26T21:36:55.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.062+0000 7f8777400640 1 -- 172.21.15.112:0/11919075 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877003e670 con 0x7f87800be7e0 2024-04-26T21:36:55.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.062+0000 7f8777400640 1 -- 172.21.15.112:0/11919075 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770037040 con 0x7f87800be7e0 2024-04-26T21:36:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.062+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87801d40e0 con 0x7f87800be7e0 2024-04-26T21:36:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.062+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87801d4690 con 0x7f87800be7e0 2024-04-26T21:36:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.062+0000 7f8777400640 1 -- 172.21.15.112:0/11919075 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8770045070 con 0x7f87800be7e0 2024-04-26T21:36:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.063+0000 7f8777400640 1 -- 172.21.15.112:0/11919075 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f877003ea60 con 0x7f87800be7e0 2024-04-26T21:36:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.063+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8780075db0 con 0x7f87800be7e0 2024-04-26T21:36:55.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.066+0000 7f8777400640 1 -- 172.21.15.112:0/11919075 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8770047450 con 0x7f87800be7e0 2024-04-26T21:36:55.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.144+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42de0ad9-495e-40ee-9e2f-62d902f26a01", "id": 6} v 0) -- 0x7f8780074290 con 0x7f87800be7e0 2024-04-26T21:36:55.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.150+0000 7f8777400640 1 -- 172.21.15.112:0/11919075 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42de0ad9-495e-40ee-9e2f-62d902f26a01", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f877003ed40 con 0x7f87800be7e0 2024-04-26T21:36:55.151 INFO:teuthology.orchestra.run.smithi112.stdout:6 2024-04-26T21:36:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.151+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 msgr2=0x7f87801d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.151+0000 7f8784e00640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f87801d3ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f87700046c0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.151+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 shutdown_connections 2024-04-26T21:36:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.151+0000 7f8784e00640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f878014c090 0x7f87801d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.151+0000 7f8784e00640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8780142830 0x7f87801d4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.151+0000 7f8784e00640 1 --2- 172.21.15.112:0/11919075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87800be7e0 0x7f87801d3ba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.152+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 >> 172.21.15.112:0/11919075 conn(0x7f87800686c0 msgr2=0x7f87800baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:55.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.152+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 shutdown_connections 2024-04-26T21:36:55.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.152+0000 7f8784e00640 1 -- 172.21.15.112:0/11919075 wait complete. 2024-04-26T21:36:55.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new c9b868df-2448-4c2f-ba2b-5551b265114c 7 2024-04-26T21:36:55.261 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:55.260+0000 7f108d5b6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T21:36:55.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.338+0000 7f302f000640 1 Processor -- start 2024-04-26T21:36:55.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.338+0000 7f302f000640 1 -- start start 2024-04-26T21:36:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.339+0000 7f302f000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f302814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.339+0000 7f302f000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f302814c090 0x7f3028142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.339+0000 7f302f000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302814c4f0 con 0x7f3028142660 2024-04-26T21:36:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.339+0000 7f302f000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f30280bebc0 con 0x7f302814c090 2024-04-26T21:36:55.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.339+0000 7f302f000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f30280b7cf0 con 0x7f30280be7e0 2024-04-26T21:36:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302dc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f302814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302d200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f302814c090 0x7f3028142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302e600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3028142660 0x7f30280b87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38238/0 (socket says 172.21.15.112:38238) 2024-04-26T21:36:55.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302e600640 1 -- 172.21.15.112:0/2404861233 learned_addr learned my addr 172.21.15.112:0/2404861233 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:36:55.341 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:55.339+0000 7febf160f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T21:36:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302dc00640 1 -- 172.21.15.112:0/2404861233 >> v2:172.21.15.112:3300/0 conn(0x7f302814c090 msgr2=0x7f3028142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302dc00640 1 --2- 172.21.15.112:0/2404861233 >> v2:172.21.15.112:3300/0 conn(0x7f302814c090 0x7f3028142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302dc00640 1 -- 172.21.15.112:0/2404861233 >> v1:172.21.15.112:6789/0 conn(0x7f3028142660 legacy=0x7f30280b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.340+0000 7f302dc00640 1 -- 172.21.15.112:0/2404861233 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30280b5d80 con 0x7f30280be7e0 2024-04-26T21:36:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.341+0000 7f302dc00640 1 --2- 172.21.15.112:0/2404861233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f302814bb50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f301c0097a0 tx=0x7f301c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed695a4089a6ddce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.341+0000 7f3027e00640 1 -- 172.21.15.112:0/2404861233 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c037070 con 0x7f30280be7e0 2024-04-26T21:36:55.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.341+0000 7f3027e00640 1 -- 172.21.15.112:0/2404861233 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301c02ae40 con 0x7f30280be7e0 2024-04-26T21:36:55.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.341+0000 7f3027e00640 1 -- 172.21.15.112:0/2404861233 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c032660 con 0x7f30280be7e0 2024-04-26T21:36:55.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 -- 172.21.15.112:0/2404861233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 msgr2=0x7f302814bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 --2- 172.21.15.112:0/2404861233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f302814bb50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f301c0097a0 tx=0x7f301c02a0f0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 -- 172.21.15.112:0/2404861233 shutdown_connections 2024-04-26T21:36:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 --2- 172.21.15.112:0/2404861233 >> v2:172.21.15.112:3300/0 conn(0x7f302814c090 0x7f3028142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 --2- 172.21.15.112:0/2404861233 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f302814bb50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 -- 172.21.15.112:0/2404861233 >> 172.21.15.112:0/2404861233 conn(0x7f30280686c0 msgr2=0x7f30280bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 -- 172.21.15.112:0/2404861233 shutdown_connections 2024-04-26T21:36:55.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.342+0000 7f302f000640 1 -- 172.21.15.112:0/2404861233 wait complete. 2024-04-26T21:36:55.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.344+0000 7f302f000640 1 Processor -- start 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.344+0000 7f302f000640 1 -- start start 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.344+0000 7f302f000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f30281d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.344+0000 7f302f000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3028142660 0x7f30281e1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.344+0000 7f302f000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f302814c090 0x7f30281e18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302f000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30280ba5e0 con 0x7f302814c090 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302f000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f30280b6c20 con 0x7f3028142660 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302f000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f30280b78c0 con 0x7f30280be7e0 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3028142660 0x7f30281e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3028142660 0x7f30281e1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43446/0 (socket says 172.21.15.112:43446) 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 -- 172.21.15.112:0/2661283403 learned_addr learned my addr 172.21.15.112:0/2661283403 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302dc00640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f30281d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302e600640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f302814c090 0x7f30281e18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 -- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 msgr2=0x7f30281d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f30281d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 -- 172.21.15.112:0/2661283403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f302814c090 msgr2=0x7f30281e18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f302814c090 0x7f30281e18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.345+0000 7f302d200640 1 -- 172.21.15.112:0/2661283403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30280ab3c0 con 0x7f3028142660 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f302d200640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3028142660 0x7f30281e1380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f301400e870 tx=0x7f301400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f3025600640 1 -- 172.21.15.112:0/2661283403 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014017070 con 0x7f3028142660 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f3025600640 1 -- 172.21.15.112:0/2661283403 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301400c940 con 0x7f3028142660 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3028145630 con 0x7f3028142660 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f3025600640 1 -- 172.21.15.112:0/2661283403 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301400cd30 con 0x7f3028142660 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30281d3c10 con 0x7f3028142660 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f3025600640 1 -- 172.21.15.112:0/2661283403 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f301401a070 con 0x7f3028142660 2024-04-26T21:36:55.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.346+0000 7f3025600640 1 -- 172.21.15.112:0/2661283403 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3014013ad0 con 0x7f3028142660 2024-04-26T21:36:55.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.347+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3028075db0 con 0x7f3028142660 2024-04-26T21:36:55.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.349+0000 7f3025600640 1 -- 172.21.15.112:0/2661283403 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3014013470 con 0x7f3028142660 2024-04-26T21:36:55.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.427+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9b868df-2448-4c2f-ba2b-5551b265114c", "id": 7} v 0) -- 0x7f3028147a00 con 0x7f3028142660 2024-04-26T21:36:55.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.433+0000 7f3025600640 1 -- 172.21.15.112:0/2661283403 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9b868df-2448-4c2f-ba2b-5551b265114c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3014013650 con 0x7f3028142660 2024-04-26T21:36:55.434 INFO:teuthology.orchestra.run.smithi112.stdout:7 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3028142660 msgr2=0x7f30281e1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3028142660 0x7f30281e1380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f301400e870 tx=0x7f301400ed30 comp rx=0 tx=0).stop 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 shutdown_connections 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f302814c090 0x7f30281e18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3028142660 0x7f30281e1380 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 --2- 172.21.15.112:0/2661283403 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30280be7e0 0x7f30281d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 >> 172.21.15.112:0/2661283403 conn(0x7f30280686c0 msgr2=0x7f30281405e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 shutdown_connections 2024-04-26T21:36:55.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:36:55.435+0000 7f302f000640 1 -- 172.21.15.112:0/2661283403 wait complete. 2024-04-26T21:36:55.452 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T21:36:55.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T21:36:55.459 INFO:tasks.ceph.osd.0:Started 2024-04-26T21:36:55.460 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T21:36:55.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T21:36:55.467 INFO:tasks.ceph.osd.1:Started 2024-04-26T21:36:55.467 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T21:36:55.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T21:36:55.474 INFO:tasks.ceph.osd.2:Started 2024-04-26T21:36:55.475 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T21:36:55.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T21:36:55.480 INFO:tasks.ceph.osd.3:Started 2024-04-26T21:36:55.480 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T21:36:55.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T21:36:55.486 INFO:tasks.ceph.osd.4:Started 2024-04-26T21:36:55.486 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T21:36:55.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T21:36:55.492 INFO:tasks.ceph.osd.5:Started 2024-04-26T21:36:55.492 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T21:36:55.492 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T21:36:55.496 INFO:tasks.ceph.osd.6:Started 2024-04-26T21:36:55.497 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T21:36:55.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T21:36:55.502 INFO:tasks.ceph.osd.7:Started 2024-04-26T21:36:55.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:36:55.593 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:55.592+0000 7f108d5b6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T21:36:55.679 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:55.678+0000 7f108d5b6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T21:36:55.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.731+0000 7f2404200640 1 Processor -- start 2024-04-26T21:36:55.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.731+0000 7f2404200640 1 -- start start 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.732+0000 7f2404200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc142b70 0x7f23fc0b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.732+0000 7f2404200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23fc14bb70 0x7f23fc152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.732+0000 7f2404200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23fc0b5e00 con 0x7f23fc0b68f0 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.732+0000 7f2404200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f23fc14bfe0 con 0x7f23fc14bb70 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.732+0000 7f2404200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f23fc0b7e80 con 0x7f23fc142b70 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2402200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23fc14bb70 0x7f23fc152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2401800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f23fc0b68f0 0x7f23fc142460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:56866/0 (socket says 172.21.15.5:56866) 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2401800640 1 -- 172.21.15.5:0/1547758534 learned_addr learned my addr 172.21.15.5:0/1547758534 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:36:55.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2400e00640 1 --2- 172.21.15.5:0/1547758534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc142b70 0x7f23fc0b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2402200640 1 -- 172.21.15.5:0/1547758534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc142b70 msgr2=0x7f23fc0b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:55.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2402200640 1 --2- 172.21.15.5:0/1547758534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc142b70 0x7f23fc0b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2402200640 1 -- 172.21.15.5:0/1547758534 >> v1:172.21.15.112:6789/0 conn(0x7f23fc0b68f0 legacy=0x7f23fc142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f2402200640 1 -- 172.21.15.5:0/1547758534 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc0b4bf0 con 0x7f23fc14bb70 2024-04-26T21:36:55.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.733+0000 7f23fbe00640 1 -- 172.21.15.5:0/1547758534 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726235369 0 0) 0x7f23fc0b5e00 con 0x7f23fc0b68f0 2024-04-26T21:36:55.735 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:55.733+0000 7febf160f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.735+0000 7f2402200640 1 --2- 172.21.15.5:0/1547758534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc14bb70 0x7f23fc152ee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d90 tx=0x7f23f402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5f3977d9f16e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.735+0000 7f23fbe00640 1 -- 172.21.15.5:0/1547758534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4031600 con 0x7f23fc14bb70 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.735+0000 7f23fbe00640 1 -- 172.21.15.5:0/1547758534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f40317a0 con 0x7f23fc14bb70 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.735+0000 7f23fbe00640 1 -- 172.21.15.5:0/1547758534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4031b70 con 0x7f23fc14bb70 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 -- 172.21.15.5:0/1547758534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc14bb70 msgr2=0x7f23fc152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 --2- 172.21.15.5:0/1547758534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc14bb70 0x7f23fc152ee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d90 tx=0x7f23f402a5d0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 -- 172.21.15.5:0/1547758534 shutdown_connections 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 --2- 172.21.15.5:0/1547758534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc14bb70 0x7f23fc152ee0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 --2- 172.21.15.5:0/1547758534 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc142b70 0x7f23fc0b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 -- 172.21.15.5:0/1547758534 >> 172.21.15.5:0/1547758534 conn(0x7f23fc068480 msgr2=0x7f23fc068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:55.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 -- 172.21.15.5:0/1547758534 shutdown_connections 2024-04-26T21:36:55.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.736+0000 7f2404200640 1 -- 172.21.15.5:0/1547758534 wait complete. 2024-04-26T21:36:55.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.737+0000 7f2404200640 1 Processor -- start 2024-04-26T21:36:55.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.738+0000 7f2404200640 1 -- start start 2024-04-26T21:36:55.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.738+0000 7f2404200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0b68f0 0x7f23fc0b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.738+0000 7f2404200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc142b70 0x7f23fc0bc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.738+0000 7f2404200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc14bb70 0x7f23fc0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.738+0000 7f2404200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc0bb580 con 0x7f23fc0b68f0 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.738+0000 7f2404200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc0bb330 con 0x7f23fc142b70 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.738+0000 7f2404200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f23fc0b52e0 con 0x7f23fc14bb70 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0b68f0 0x7f23fc0b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0b68f0 0x7f23fc0b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60472/0 (socket says 172.21.15.5:60472) 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 -- 172.21.15.5:0/2019307014 learned_addr learned my addr 172.21.15.5:0/2019307014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2400e00640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc142b70 0x7f23fc0bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2402200640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc14bb70 0x7f23fc0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 -- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc14bb70 msgr2=0x7f23fc0bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc14bb70 0x7f23fc0bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 -- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc142b70 msgr2=0x7f23fc0bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc142b70 0x7f23fc0bc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 -- 172.21.15.5:0/2019307014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc0bdec0 con 0x7f23fc0b68f0 2024-04-26T21:36:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.739+0000 7f2401800640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0b68f0 0x7f23fc0b4350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23f000c500 tx=0x7f23f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.740+0000 7f23f9600640 1 -- 172.21.15.5:0/2019307014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0018070 con 0x7f23fc0b68f0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.740+0000 7f23f9600640 1 -- 172.21.15.5:0/2019307014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f0007580 con 0x7f23fc0b68f0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.740+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc0be7f0 con 0x7f23fc0b68f0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.740+0000 7f23f9600640 1 -- 172.21.15.5:0/2019307014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0004a20 con 0x7f23fc0b68f0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.740+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc0b3540 con 0x7f23fc0b68f0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.740+0000 7f23f9600640 1 -- 172.21.15.5:0/2019307014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23f001b070 con 0x7f23fc0b68f0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.740+0000 7f23f9600640 1 -- 172.21.15.5:0/2019307014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f23f0004bc0 con 0x7f23fc0b68f0 2024-04-26T21:36:55.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.741+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23fc0ba170 con 0x7f23fc0b68f0 2024-04-26T21:36:55.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.746+0000 7f23f9600640 1 -- 172.21.15.5:0/2019307014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f23fc0ba170 con 0x7f23fc0b68f0 2024-04-26T21:36:55.801 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:55.801+0000 7febf160f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T21:36:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.811+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23fc075db0 con 0x7f23fc0b68f0 2024-04-26T21:36:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.812+0000 7f23f9600640 1 -- 172.21.15.5:0/2019307014 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f23f0022080 con 0x7f23fc0b68f0 2024-04-26T21:36:55.813 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:36:55.813 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:36:55.430094+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:36:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.813+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0b68f0 msgr2=0x7f23fc0b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.813+0000 7f2404200640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0b68f0 0x7f23fc0b4350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23f000c500 tx=0x7f23f000c9c0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.814+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 shutdown_connections 2024-04-26T21:36:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.814+0000 7f2404200640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f23fc14bb70 0x7f23fc0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.814+0000 7f2404200640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc142b70 0x7f23fc0bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.814+0000 7f2404200640 1 --2- 172.21.15.5:0/2019307014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0b68f0 0x7f23fc0b4350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.814+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 >> 172.21.15.5:0/2019307014 conn(0x7f23fc068480 msgr2=0x7f23fc140410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.814+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 shutdown_connections 2024-04-26T21:36:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:36:55.814+0000 7f2404200640 1 -- 172.21.15.5:0/2019307014 wait complete. 2024-04-26T21:36:55.815 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:55.814+0000 7f108d5b6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T21:36:55.831 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T21:36:55.831 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T21:36:55.942 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:55.942+0000 7febf160f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T21:36:56.138 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:56.137+0000 7f108d5b6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T21:36:56.166 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:36:56.165+0000 7fb9b2c63640 -1 Falling back to public interface 2024-04-26T21:36:56.170 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:36:56.170+0000 7fc720221640 -1 Falling back to public interface 2024-04-26T21:36:56.184 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-26T21:36:56.184+0000 7f9ca1612640 -1 Falling back to public interface 2024-04-26T21:36:56.185 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-26T21:36:56.184+0000 7fd1f3884640 -1 Falling back to public interface 2024-04-26T21:36:56.194 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-26T21:36:56.194+0000 7f4c06e1c640 -1 Falling back to public interface 2024-04-26T21:36:56.196 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:56.195+0000 7f108d5b6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T21:36:56.200 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-26T21:36:56.200+0000 7f574e326640 -1 Falling back to public interface 2024-04-26T21:36:56.203 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:36:56.203+0000 7f159ba31640 -1 Falling back to public interface 2024-04-26T21:36:56.220 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:36:56.220+0000 7fac55e2e640 -1 Falling back to public interface 2024-04-26T21:36:56.290 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:56.290+0000 7febf160f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T21:36:56.349 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:56.349+0000 7febf160f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T21:36:56.383 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:56.382+0000 7f108d5b6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T21:36:56.540 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:56.540+0000 7febf160f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T21:36:56.552 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:56.552+0000 7f108d5b6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T21:36:56.610 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:56.609+0000 7f108d5b6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T21:36:56.637 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:36:56.689 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:56.688+0000 7f108d5b6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T21:36:56.717 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:56.716+0000 7febf160f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T21:36:56.743 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:56.742+0000 7f108d5b6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T21:36:56.779 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:56.779+0000 7febf160f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T21:36:56.807 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.806+0000 7fb52b000640 1 Processor -- start 2024-04-26T21:36:56.807 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.807+0000 7fb52b000640 1 -- start start 2024-04-26T21:36:56.808 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.808+0000 7fb52b000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb5240b7230 0x7fb524142280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:56.808 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.808+0000 7fb52b000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5240b6620 con 0x7fb5241427c0 2024-04-26T21:36:56.808 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.808+0000 7fb52b000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5240b5b70 con 0x7fb5240b6240 2024-04-26T21:36:56.808 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.808+0000 7fb52b000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb5241496c0 con 0x7fb5240b7230 2024-04-26T21:36:56.808 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.808+0000 7fb529000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5241427c0 0x7fb524153000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55846/0 (socket says 172.21.15.5:55846) 2024-04-26T21:36:56.809 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.808+0000 7fb529000640 1 -- 172.21.15.5:0/538594342 learned_addr learned my addr 172.21.15.5:0/538594342 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:36:56.809 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.808+0000 7fb51be00640 1 --2- 172.21.15.5:0/538594342 >> v2:172.21.15.112:3300/0 conn(0x7fb5240b7230 0x7fb524142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:56.809 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.809+0000 7fb523400640 1 -- 172.21.15.5:0/538594342 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546499755 0 0) 0x7fb5240b6620 con 0x7fb5241427c0 2024-04-26T21:36:56.809 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.809+0000 7fb523400640 1 -- 172.21.15.5:0/538594342 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb508003520 con 0x7fb5241427c0 2024-04-26T21:36:56.809 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.809+0000 7fb51be00640 1 -- 172.21.15.5:0/538594342 >> v1:172.21.15.112:6789/0 conn(0x7fb5240b6240 legacy=0x7fb524148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:36:56.810 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.809+0000 7fb51be00640 1 -- 172.21.15.5:0/538594342 >> v1:172.21.15.5:6789/0 conn(0x7fb5241427c0 legacy=0x7fb524153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:56.810 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.809+0000 7fb51be00640 1 -- 172.21.15.5:0/538594342 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5240b81d0 con 0x7fb5240b7230 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.810+0000 7fb51be00640 1 --2- 172.21.15.5:0/538594342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5240b7230 0x7fb524142280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0097a0 tx=0x7fb50c02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef425d389ee6a363 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.810+0000 7fb523400640 1 -- 172.21.15.5:0/538594342 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c037070 con 0x7fb5240b7230 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.810+0000 7fb523400640 1 -- 172.21.15.5:0/538594342 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50c02ae50 con 0x7fb5240b7230 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.810+0000 7fb523400640 1 -- 172.21.15.5:0/538594342 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c032660 con 0x7fb5240b7230 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.811+0000 7fb52b000640 1 -- 172.21.15.5:0/538594342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5240b7230 msgr2=0x7fb524142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.811+0000 7fb52b000640 1 --2- 172.21.15.5:0/538594342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5240b7230 0x7fb524142280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0097a0 tx=0x7fb50c02a140 comp rx=0 tx=0).stop 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.811+0000 7fb52b000640 1 -- 172.21.15.5:0/538594342 shutdown_connections 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.811+0000 7fb52b000640 1 --2- 172.21.15.5:0/538594342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5240b7230 0x7fb524142280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:56.812 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.811+0000 7fb52b000640 1 -- 172.21.15.5:0/538594342 >> 172.21.15.5:0/538594342 conn(0x7fb5240bab20 msgr2=0x7fb5240baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:56.813 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.811+0000 7fb52b000640 1 -- 172.21.15.5:0/538594342 shutdown_connections 2024-04-26T21:36:56.813 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.811+0000 7fb52b000640 1 -- 172.21.15.5:0/538594342 wait complete. 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.812+0000 7fb52b000640 1 Processor -- start 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.813+0000 7fb52b000640 1 -- start start 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.813+0000 7fb52b000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5240b6240 0x7fb52414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.813+0000 7fb52b000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5240b7230 0x7fb524144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.813+0000 7fb52b000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241427c0 0x7fb5240b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.813+0000 7fb52b000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5240b6a60 con 0x7fb5240b6240 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.813+0000 7fb52b000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb524148b20 con 0x7fb5241427c0 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.813+0000 7fb52b000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb5240b6be0 con 0x7fb5240b7230 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5240b6240 0x7fb52414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5240b6240 0x7fb52414b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60484/0 (socket says 172.21.15.5:60484) 2024-04-26T21:36:56.814 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 -- 172.21.15.5:0/3882910875 learned_addr learned my addr 172.21.15.5:0/3882910875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:36:56.815 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb51be00640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5240b7230 0x7fb524144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:56.815 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb529000640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241427c0 0x7fb5240b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 -- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5240b7230 msgr2=0x7fb524144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5240b7230 0x7fb524144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 -- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241427c0 msgr2=0x7fb5240b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241427c0 0x7fb5240b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.814+0000 7fb523e00640 1 -- 172.21.15.5:0/3882910875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5240ab240 con 0x7fb5240b6240 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb523e00640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5240b6240 0x7fb52414b6f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c430 tx=0x7fb51400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb520c00640 1 -- 172.21.15.5:0/3882910875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514011790 con 0x7fb5240b6240 2024-04-26T21:36:56.816 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb520c00640 1 -- 172.21.15.5:0/3882910875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb514017070 con 0x7fb5240b6240 2024-04-26T21:36:56.817 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb524145210 con 0x7fb5240b6240 2024-04-26T21:36:56.817 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb520c00640 1 -- 172.21.15.5:0/3882910875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514011b70 con 0x7fb5240b6240 2024-04-26T21:36:56.817 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52414c390 con 0x7fb5240b6240 2024-04-26T21:36:56.817 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb520c00640 1 -- 172.21.15.5:0/3882910875 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb514011d10 con 0x7fb5240b6240 2024-04-26T21:36:56.817 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.815+0000 7fb520c00640 1 -- 172.21.15.5:0/3882910875 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb514012d20 con 0x7fb5240b6240 2024-04-26T21:36:56.817 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.816+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb524069d00 con 0x7fb5240b6240 2024-04-26T21:36:56.819 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.819+0000 7fb520c00640 1 -- 172.21.15.5:0/3882910875 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb514012650 con 0x7fb5240b6240 2024-04-26T21:36:56.867 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:56.866+0000 7febf160f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T21:36:56.886 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.885+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5240ab4b0 con 0x7fb5240b6240 2024-04-26T21:36:56.887 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.887+0000 7fb520c00640 1 -- 172.21.15.5:0/3882910875 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb514012870 con 0x7fb5240b6240 2024-04-26T21:36:56.887 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-26T21:36:56.887 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:36:55.430094+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:36:56.888 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5240b6240 msgr2=0x7fb52414b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:36:56.888 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5240b6240 0x7fb52414b6f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c430 tx=0x7fb51400c8f0 comp rx=0 tx=0).stop 2024-04-26T21:36:56.889 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 shutdown_connections 2024-04-26T21:36:56.889 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5241427c0 0x7fb5240b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:56.889 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5240b7230 0x7fb524144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:56.889 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 --2- 172.21.15.5:0/3882910875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5240b6240 0x7fb52414b6f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:36:56.889 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 >> 172.21.15.5:0/3882910875 conn(0x7fb5240bab20 msgr2=0x7fb524146880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:36:56.889 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 shutdown_connections 2024-04-26T21:36:56.889 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:36:56.888+0000 7fb52b000640 1 -- 172.21.15.5:0/3882910875 wait complete. 2024-04-26T21:36:56.901 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T21:36:56.924 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:56.924+0000 7febf160f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T21:36:57.283 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:57.283+0000 7f108d5b6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T21:36:57.416 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:57.415+0000 7f108d5b6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T21:36:57.497 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:57.496+0000 7febf160f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T21:36:57.634 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-26T21:36:57.633+0000 7febf160f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T21:36:58.464 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:58.464+0000 7f102dc00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T21:36:58.465 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:36:58.464+0000 7f102dc00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T21:36:59.618 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:36:59.617+0000 7fc720221640 -1 osd.5 0 log_to_monitors true 2024-04-26T21:36:59.788 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:36:59.788+0000 7fb9b2c63640 -1 osd.6 0 log_to_monitors true 2024-04-26T21:36:59.840 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:36:59.840+0000 7f159ba31640 -1 osd.7 0 log_to_monitors true 2024-04-26T21:36:59.850 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-26T21:36:59.849+0000 7f4c06e1c640 -1 osd.2 0 log_to_monitors true 2024-04-26T21:36:59.853 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-26T21:36:59.852+0000 7f9ca1612640 -1 osd.1 0 log_to_monitors true 2024-04-26T21:36:59.861 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-26T21:36:59.860+0000 7f574e326640 -1 osd.3 0 log_to_monitors true 2024-04-26T21:36:59.879 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:36:59.879+0000 7fac55e2e640 -1 osd.4 0 log_to_monitors true 2024-04-26T21:37:00.023 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-26T21:37:00.022+0000 7fd1f3884640 -1 osd.0 0 log_to_monitors true 2024-04-26T21:37:03.198 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-26T21:37:03.197+0000 7f5749200640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T21:37:03.202 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-26T21:37:03.201+0000 7f9c9c000640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T21:37:03.208 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-04-26T21:37:03.207+0000 7f9c92000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.211 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-04-26T21:37:03.210+0000 7f573f200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.248 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-26T21:37:03.247+0000 7fd1ee800640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T21:37:03.252 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-26T21:37:03.251+0000 7f4c01600640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T21:37:03.255 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-04-26T21:37:03.254+0000 7fd1e4800640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.260 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-04-26T21:37:03.259+0000 7f4bf7600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.708 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:03.713 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:37:03.713+0000 7f1595e00640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T21:37:03.721 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:37:03.721+0000 7f158be00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.826 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:37:03.826+0000 7fc71b000640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T21:37:03.831 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:37:03.831+0000 7fc711000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.838 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:37:03.838+0000 7fac50200640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T21:37:03.855 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:37:03.855+0000 7fac46200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.882 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:37:03.882+0000 7fb9adc00640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T21:37:03.889 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:37:03.889+0000 7fb9a3c00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:37:03.901 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.900+0000 7f6978600640 1 Processor -- start 2024-04-26T21:37:03.901 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.900+0000 7f6978600640 1 -- start start 2024-04-26T21:37:03.903 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6978600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f697013cdf0 0x7f6970147180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:03.903 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6978600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69701466a0 con 0x7f69700b4a60 2024-04-26T21:37:03.903 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6978600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6970146980 con 0x7f697013d1d0 2024-04-26T21:37:03.903 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6978600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f69700b4ef0 con 0x7f697013cdf0 2024-04-26T21:37:03.903 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6975c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f697013cdf0 0x7f6970147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:03.903 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6976600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f69700b4a60 0x7f69700ba770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55854/0 (socket says 172.21.15.5:55854) 2024-04-26T21:37:03.903 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6976600640 1 -- 172.21.15.5:0/1158199627 learned_addr learned my addr 172.21.15.5:0/1158199627 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:03.904 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6975c00640 1 -- 172.21.15.5:0/1158199627 >> v1:172.21.15.112:6789/0 conn(0x7f697013d1d0 legacy=0x7f6970070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:03.904 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f696fe00640 1 -- 172.21.15.5:0/1158199627 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956057802 0 0) 0x7f69701466a0 con 0x7f69700b4a60 2024-04-26T21:37:03.904 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6975c00640 1 -- 172.21.15.5:0/1158199627 >> v1:172.21.15.5:6789/0 conn(0x7f69700b4a60 legacy=0x7f69700ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:03.904 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.902+0000 7f6975c00640 1 -- 172.21.15.5:0/1158199627 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6970146c60 con 0x7f697013cdf0 2024-04-26T21:37:03.905 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.903+0000 7f6975c00640 1 --2- 172.21.15.5:0/1158199627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013cdf0 0x7f6970147180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f69600097d0 tx=0x7f696002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4d266a48f60961 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:03.905 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f696fe00640 1 -- 172.21.15.5:0/1158199627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960037070 con 0x7f697013cdf0 2024-04-26T21:37:03.905 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f696fe00640 1 -- 172.21.15.5:0/1158199627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6960032440 con 0x7f697013cdf0 2024-04-26T21:37:03.905 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f696fe00640 1 -- 172.21.15.5:0/1158199627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960032810 con 0x7f697013cdf0 2024-04-26T21:37:03.906 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f6978600640 1 -- 172.21.15.5:0/1158199627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013cdf0 msgr2=0x7f6970147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:03.906 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f6978600640 1 --2- 172.21.15.5:0/1158199627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013cdf0 0x7f6970147180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f69600097d0 tx=0x7f696002a1c0 comp rx=0 tx=0).stop 2024-04-26T21:37:03.906 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f6978600640 1 -- 172.21.15.5:0/1158199627 shutdown_connections 2024-04-26T21:37:03.906 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f6978600640 1 --2- 172.21.15.5:0/1158199627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013cdf0 0x7f6970147180 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:03.906 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f6978600640 1 -- 172.21.15.5:0/1158199627 >> 172.21.15.5:0/1158199627 conn(0x7f697006c9b0 msgr2=0x7f69700ba060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:03.906 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f6978600640 1 -- 172.21.15.5:0/1158199627 shutdown_connections 2024-04-26T21:37:03.906 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.904+0000 7f6978600640 1 -- 172.21.15.5:0/1158199627 wait complete. 2024-04-26T21:37:03.907 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.906+0000 7f6978600640 1 Processor -- start 2024-04-26T21:37:03.907 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.906+0000 7f6978600640 1 -- start start 2024-04-26T21:37:03.908 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6978600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700b4a60 0x7f697014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:03.908 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6978600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f697013cdf0 0x7f69701dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:03.908 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6978600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013d1d0 0x7f697013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:03.908 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6978600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6970151f20 con 0x7f697013d1d0 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6978600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6970140ba0 con 0x7f69700b4a60 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6978600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f69701520a0 con 0x7f697013cdf0 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700b4a60 0x7f697014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6976600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013d1d0 0x7f697013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700b4a60 0x7f697014a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:37670/0 (socket says 172.21.15.5:37670) 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 -- 172.21.15.5:0/1034077422 learned_addr learned my addr 172.21.15.5:0/1034077422 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975200640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f697013cdf0 0x7f69701dfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 -- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f697013cdf0 msgr2=0x7f69701dfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f697013cdf0 0x7f69701dfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 -- 172.21.15.5:0/1034077422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013d1d0 msgr2=0x7f697013f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013d1d0 0x7f697013f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6975c00640 1 -- 172.21.15.5:0/1034077422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697014a6f0 con 0x7f69700b4a60 2024-04-26T21:37:03.909 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.907+0000 7f6976600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013d1d0 0x7f697013f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:37:03.910 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.908+0000 7f6975c00640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700b4a60 0x7f697014a0f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f69600098f0 tx=0x7f69600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:03.910 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.908+0000 7f696d600640 1 -- 172.21.15.5:0/1034077422 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960037040 con 0x7f69700b4a60 2024-04-26T21:37:03.910 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.908+0000 7f696d600640 1 -- 172.21.15.5:0/1034077422 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6960042070 con 0x7f69700b4a60 2024-04-26T21:37:03.911 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.908+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69701e0570 con 0x7f69700b4a60 2024-04-26T21:37:03.911 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.908+0000 7f696d600640 1 -- 172.21.15.5:0/1034077422 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960030bf0 con 0x7f69700b4a60 2024-04-26T21:37:03.911 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.908+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6970147750 con 0x7f69700b4a60 2024-04-26T21:37:03.911 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.909+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69700b4460 con 0x7f69700b4a60 2024-04-26T21:37:03.911 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.910+0000 7f696d600640 1 -- 172.21.15.5:0/1034077422 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f6960047460 con 0x7f69700b4a60 2024-04-26T21:37:03.912 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.911+0000 7f696d600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f695006c860 0x7f695006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:03.912 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.911+0000 7f696d600640 1 -- 172.21.15.5:0/1034077422 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f69600ab860 con 0x7f69700b4a60 2024-04-26T21:37:03.912 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.911+0000 7f6975200640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f695006c860 0x7f695006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:03.913 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.912+0000 7f6975200640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f695006c860 0x7f695006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f695c000f60 tx=0x7f695c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:03.919 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:03.918+0000 7f696d600640 1 -- 172.21.15.5:0/1034077422 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f69700b4460 con 0x7f69700b4a60 2024-04-26T21:37:04.115 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.114+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6970069d00 con 0x7f69700b4a60 2024-04-26T21:37:04.117 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.116+0000 7f696d600640 1 -- 172.21.15.5:0/1034077422 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f6960032e20 con 0x7f69700b4a60 2024-04-26T21:37:04.117 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-26T21:37:04.117 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":12,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:01.458975+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f695006c860 msgr2=0x7f695006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f695006c860 0x7f695006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f695c000f60 tx=0x7f695c009040 comp rx=0 tx=0).stop 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700b4a60 msgr2=0x7f697014a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700b4a60 0x7f697014a0f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f69600098f0 tx=0x7f69600046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 shutdown_connections 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f695006c860 0x7f695006ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f697013d1d0 0x7f697013f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f697013cdf0 0x7f69701dfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 --2- 172.21.15.5:0/1034077422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69700b4a60 0x7f697014a0f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.118+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 >> 172.21.15.5:0/1034077422 conn(0x7f697006c9b0 msgr2=0x7f69700b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:04.120 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.119+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 shutdown_connections 2024-04-26T21:37:04.121 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:04.119+0000 7f6978600640 1 -- 172.21.15.5:0/1034077422 wait complete. 2024-04-26T21:37:04.133 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T21:37:10.940 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:11.133 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.132+0000 7fc727a00640 1 Processor -- start 2024-04-26T21:37:11.133 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.132+0000 7fc727a00640 1 -- start start 2024-04-26T21:37:11.135 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.133+0000 7fc727a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc720146f50 0x7fc720158600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.135 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.133+0000 7fc727a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7200b3d20 con 0x7fc720150b20 2024-04-26T21:37:11.135 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.133+0000 7fc727a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7200b2780 con 0x7fc7200baa40 2024-04-26T21:37:11.135 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.133+0000 7fc727a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc7201473c0 con 0x7fc720146f50 2024-04-26T21:37:11.135 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc71fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc720150b20 0x7fc720146840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33892/0 (socket says 172.21.15.5:33892) 2024-04-26T21:37:11.135 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc71fe00640 1 -- 172.21.15.5:0/2062354323 learned_addr learned my addr 172.21.15.5:0/2062354323 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:11.135 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc725a00640 1 --2- 172.21.15.5:0/2062354323 >> v2:172.21.15.5:3300/0 conn(0x7fc720146f50 0x7fc720158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.136 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc71f400640 1 -- 172.21.15.5:0/2062354323 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294650034 0 0) 0x7fc7200b3d20 con 0x7fc720150b20 2024-04-26T21:37:11.136 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc71f400640 1 -- 172.21.15.5:0/2062354323 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc704003520 con 0x7fc720150b20 2024-04-26T21:37:11.136 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc725a00640 1 -- 172.21.15.5:0/2062354323 >> v1:172.21.15.112:6789/0 conn(0x7fc7200baa40 legacy=0x7fc720150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.136 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc725a00640 1 -- 172.21.15.5:0/2062354323 >> v1:172.21.15.5:6789/0 conn(0x7fc720150b20 legacy=0x7fc720146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.136 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.134+0000 7fc725a00640 1 -- 172.21.15.5:0/2062354323 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7200b2a60 con 0x7fc720146f50 2024-04-26T21:37:11.137 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.135+0000 7fc725a00640 1 --2- 172.21.15.5:0/2062354323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720146f50 0x7fc720158600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7180097d0 tx=0x7fc71802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491d341e941dfde9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.137 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc71f400640 1 -- 172.21.15.5:0/2062354323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718037070 con 0x7fc720146f50 2024-04-26T21:37:11.137 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc71f400640 1 -- 172.21.15.5:0/2062354323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71802ae40 con 0x7fc720146f50 2024-04-26T21:37:11.137 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc71f400640 1 -- 172.21.15.5:0/2062354323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718032660 con 0x7fc720146f50 2024-04-26T21:37:11.138 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc727a00640 1 -- 172.21.15.5:0/2062354323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720146f50 msgr2=0x7fc720158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.138 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc727a00640 1 --2- 172.21.15.5:0/2062354323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720146f50 0x7fc720158600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7180097d0 tx=0x7fc71802a130 comp rx=0 tx=0).stop 2024-04-26T21:37:11.138 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc727a00640 1 -- 172.21.15.5:0/2062354323 shutdown_connections 2024-04-26T21:37:11.138 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc727a00640 1 --2- 172.21.15.5:0/2062354323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720146f50 0x7fc720158600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.138 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc727a00640 1 -- 172.21.15.5:0/2062354323 >> 172.21.15.5:0/2062354323 conn(0x7fc72006c9b0 msgr2=0x7fc7200ba060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:11.138 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc727a00640 1 -- 172.21.15.5:0/2062354323 shutdown_connections 2024-04-26T21:37:11.138 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.136+0000 7fc727a00640 1 -- 172.21.15.5:0/2062354323 wait complete. 2024-04-26T21:37:11.139 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.138+0000 7fc727a00640 1 Processor -- start 2024-04-26T21:37:11.139 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.138+0000 7fc727a00640 1 -- start start 2024-04-26T21:37:11.142 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc727a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7200baa40 0x7fc720073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.142 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc727a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc720146f50 0x7fc720141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.142 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc727a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720150b20 0x7fc720141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.142 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc727a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200b1560 con 0x7fc720150b20 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc727a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200bae20 con 0x7fc7200baa40 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc727a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc7200b16e0 con 0x7fc720146f50 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc725a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720150b20 0x7fc720141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc725a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720150b20 0x7fc720141940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48272/0 (socket says 172.21.15.5:48272) 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.139+0000 7fc725a00640 1 -- 172.21.15.5:0/2431510087 learned_addr learned my addr 172.21.15.5:0/2431510087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc71fe00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc720146f50 0x7fc720141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725000640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7200baa40 0x7fc720073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725a00640 1 -- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc720146f50 msgr2=0x7fc720141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc720146f50 0x7fc720141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725a00640 1 -- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7200baa40 msgr2=0x7fc720073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.146 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7200baa40 0x7fc720073380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.147 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725a00640 1 -- 172.21.15.5:0/2431510087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc720143000 con 0x7fc720150b20 2024-04-26T21:37:11.147 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725000640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7200baa40 0x7fc720073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:11.147 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc725a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720150b20 0x7fc720141940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc718035040 tx=0x7fc7180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.147 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.140+0000 7fc71cc00640 1 -- 172.21.15.5:0/2431510087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718041070 con 0x7fc720150b20 2024-04-26T21:37:11.147 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.141+0000 7fc71cc00640 1 -- 172.21.15.5:0/2431510087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71803c460 con 0x7fc720150b20 2024-04-26T21:37:11.147 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.141+0000 7fc71cc00640 1 -- 172.21.15.5:0/2431510087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718037040 con 0x7fc720150b20 2024-04-26T21:37:11.147 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.141+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc720142d20 con 0x7fc720150b20 2024-04-26T21:37:11.148 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.141+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc720143630 con 0x7fc720150b20 2024-04-26T21:37:11.148 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.142+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc720069d00 con 0x7fc720150b20 2024-04-26T21:37:11.148 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.143+0000 7fc71cc00640 1 -- 172.21.15.5:0/2431510087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc718044070 con 0x7fc720150b20 2024-04-26T21:37:11.148 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.145+0000 7fc71cc00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc6fc06c8f0 0x7fc6fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.149 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.145+0000 7fc71cc00640 1 -- 172.21.15.5:0/2431510087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc7180abf50 con 0x7fc720150b20 2024-04-26T21:37:11.149 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.145+0000 7fc725000640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc6fc06c8f0 0x7fc6fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.149 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.147+0000 7fc725000640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc6fc06c8f0 0x7fc6fc06edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc710001d70 tx=0x7fc710009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.151 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.150+0000 7fc71cc00640 1 -- 172.21.15.5:0/2431510087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc720143000 con 0x7fc720150b20 2024-04-26T21:37:11.358 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.357+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc72014bfa0 con 0x7fc720150b20 2024-04-26T21:37:11.360 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.358+0000 7fc71cc00640 1 -- 172.21.15.5:0/2431510087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12812 (secure 0 0 0) 0x7fc71807a7e0 con 0x7fc720150b20 2024-04-26T21:37:11.360 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-26T21:37:11.360 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":16,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:07.740395+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.361+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc6fc06c8f0 msgr2=0x7fc6fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.361+0000 7fc727a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc6fc06c8f0 0x7fc6fc06edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc710001d70 tx=0x7fc710009040 comp rx=0 tx=0).stop 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.361+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720150b20 msgr2=0x7fc720141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.361+0000 7fc727a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720150b20 0x7fc720141940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc718035040 tx=0x7fc7180046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 shutdown_connections 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc6fc06c8f0 0x7fc6fc06edb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc720150b20 0x7fc720141940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.363 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc720146f50 0x7fc720141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.364 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 --2- 172.21.15.5:0/2431510087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7200baa40 0x7fc720073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.364 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 >> 172.21.15.5:0/2431510087 conn(0x7fc72006c9b0 msgr2=0x7fc7200b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:11.364 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 shutdown_connections 2024-04-26T21:37:11.364 INFO:teuthology.misc.health.smithi005.stderr:2024-04-26T21:37:11.362+0000 7fc727a00640 1 -- 172.21.15.5:0/2431510087 wait complete. 2024-04-26T21:37:11.378 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T21:37:11.379 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T21:37:11.379 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T21:37:11.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T21:37:11.387 INFO:tasks.ceph.mds.a:Started 2024-04-26T21:37:11.387 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T21:37:11.387 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T21:37:11.394 INFO:tasks.ceph.mds.b:Started 2024-04-26T21:37:11.395 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T21:37:11.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:11.554 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-26T21:37:11.570 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-04-26T21:37:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.588+0000 7f14eac00640 1 Processor -- start 2024-04-26T21:37:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.588+0000 7f14eac00640 1 -- start start 2024-04-26T21:37:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.589+0000 7f14eac00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14e40b68f0 0x7f14e40b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.589+0000 7f14eac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e414bb70 0x7f14e4142460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.589+0000 7f14eac00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e40b5e00 con 0x7f14e41429a0 2024-04-26T21:37:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.589+0000 7f14eac00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f14e40b7e80 con 0x7f14e40b68f0 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.589+0000 7f14eac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f14e40bb330 con 0x7f14e414bb70 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14e40b68f0 0x7f14e40b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e8c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f14e41429a0 0x7f14e40b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33904/0 (socket says 172.21.15.5:33904) 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e8c00640 1 -- 172.21.15.5:0/249758912 learned_addr learned my addr 172.21.15.5:0/249758912 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e3400640 1 --2- 172.21.15.5:0/249758912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e414bb70 0x7f14e4142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e2a00640 1 -- 172.21.15.5:0/249758912 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835940188 0 0) 0x7f14e40b5e00 con 0x7f14e41429a0 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e2a00640 1 -- 172.21.15.5:0/249758912 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14c8003520 con 0x7f14e41429a0 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e3e00640 1 -- 172.21.15.5:0/249758912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e414bb70 msgr2=0x7f14e4142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e3e00640 1 --2- 172.21.15.5:0/249758912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e414bb70 0x7f14e4142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e3e00640 1 -- 172.21.15.5:0/249758912 >> v1:172.21.15.5:6789/0 conn(0x7f14e41429a0 legacy=0x7f14e40b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.590+0000 7f14e3e00640 1 -- 172.21.15.5:0/249758912 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e40b4bf0 con 0x7f14e40b68f0 2024-04-26T21:37:11.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.591+0000 7f14e3e00640 1 --2- 172.21.15.5:0/249758912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e40b68f0 0x7f14e40b5770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14d40097a0 tx=0x7f14d402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d4e642e3613a86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14e2a00640 1 -- 172.21.15.5:0/249758912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4037070 con 0x7f14e40b68f0 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14e2a00640 1 -- 172.21.15.5:0/249758912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d402ae50 con 0x7f14e40b68f0 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14e2a00640 1 -- 172.21.15.5:0/249758912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4032660 con 0x7f14e40b68f0 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 -- 172.21.15.5:0/249758912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e40b68f0 msgr2=0x7f14e40b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 --2- 172.21.15.5:0/249758912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e40b68f0 0x7f14e40b5770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14d40097a0 tx=0x7f14d402a100 comp rx=0 tx=0).stop 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 -- 172.21.15.5:0/249758912 shutdown_connections 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 --2- 172.21.15.5:0/249758912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e414bb70 0x7f14e4142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 --2- 172.21.15.5:0/249758912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e40b68f0 0x7f14e40b5770 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 -- 172.21.15.5:0/249758912 >> 172.21.15.5:0/249758912 conn(0x7f14e4068480 msgr2=0x7f14e4068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 -- 172.21.15.5:0/249758912 shutdown_connections 2024-04-26T21:37:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.592+0000 7f14eac00640 1 -- 172.21.15.5:0/249758912 wait complete. 2024-04-26T21:37:11.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.594+0000 7f14eac00640 1 Processor -- start 2024-04-26T21:37:11.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.594+0000 7f14eac00640 1 -- start start 2024-04-26T21:37:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14eac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e40b68f0 0x7f14e413e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14eac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e41429a0 0x7f14e4144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14eac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e414bb70 0x7f14e41e1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14eac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40b52e0 con 0x7f14e41429a0 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14eac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40bb580 con 0x7f14e414bb70 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14eac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f14e414bfb0 con 0x7f14e40b68f0 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14e3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e40b68f0 0x7f14e413e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14e3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e41429a0 0x7f14e4144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14e3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e40b68f0 0x7f14e413e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:46978/0 (socket says 172.21.15.5:46978) 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.595+0000 7f14e3e00640 1 -- 172.21.15.5:0/847857352 learned_addr learned my addr 172.21.15.5:0/847857352 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14e8c00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e414bb70 0x7f14e41e1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14e3400640 1 -- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e40b68f0 msgr2=0x7f14e413e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14e3400640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e40b68f0 0x7f14e413e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14e3400640 1 -- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e414bb70 msgr2=0x7f14e41e1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14e3400640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e414bb70 0x7f14e41e1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14e3400640 1 -- 172.21.15.5:0/847857352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e4145e00 con 0x7f14e41429a0 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14e3400640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e41429a0 0x7f14e4144940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e870 tx=0x7f14d000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.596+0000 7f14dbe00640 1 -- 172.21.15.5:0/847857352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0017070 con 0x7f14e41429a0 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.597+0000 7f14dbe00640 1 -- 172.21.15.5:0/847857352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d000ee60 con 0x7f14e41429a0 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.597+0000 7f14dbe00640 1 -- 172.21.15.5:0/847857352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d000cb60 con 0x7f14e41429a0 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.597+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e4144e80 con 0x7f14e41429a0 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.597+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e41460b0 con 0x7f14e41429a0 2024-04-26T21:37:11.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.598+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e4075db0 con 0x7f14e41429a0 2024-04-26T21:37:11.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.599+0000 7f14dbe00640 1 -- 172.21.15.5:0/847857352 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14d001a070 con 0x7f14e41429a0 2024-04-26T21:37:11.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.600+0000 7f14dbe00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c406c8f0 0x7f14c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:11.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.600+0000 7f14dbe00640 1 -- 172.21.15.5:0/847857352 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f14d008b580 con 0x7f14e41429a0 2024-04-26T21:37:11.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.601+0000 7f14e3e00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c406c8f0 0x7f14c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:11.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.601+0000 7f14e3e00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c406c8f0 0x7f14c406edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14d402a140 tx=0x7f14d402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:11.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.605+0000 7f14dbe00640 1 -- 172.21.15.5:0/847857352 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f14d00596a0 con 0x7f14e41429a0 2024-04-26T21:37:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.811+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14e4141be0 con 0x7f14e41429a0 2024-04-26T21:37:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.814+0000 7f14dbe00640 1 -- 172.21.15.5:0/847857352 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12812 (secure 0 0 0) 0x7f14d005d9a0 con 0x7f14e41429a0 2024-04-26T21:37:11.815 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:11.815 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:07.740395+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c406c8f0 msgr2=0x7f14c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c406c8f0 0x7f14c406edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14d402a140 tx=0x7f14d402e000 comp rx=0 tx=0).stop 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e41429a0 msgr2=0x7f14e4144940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e41429a0 0x7f14e4144940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e870 tx=0x7f14d000ed30 comp rx=0 tx=0).stop 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 shutdown_connections 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e414bb70 0x7f14e41e1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c406c8f0 0x7f14c406edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e41429a0 0x7f14e4144940 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 --2- 172.21.15.5:0/847857352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e40b68f0 0x7f14e413e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 >> 172.21.15.5:0/847857352 conn(0x7f14e4068480 msgr2=0x7f14e4068860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 shutdown_connections 2024-04-26T21:37:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:11.816+0000 7f14eac00640 1 -- 172.21.15.5:0/847857352 wait complete. 2024-04-26T21:37:11.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:37:11.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:37:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.048+0000 7fa1e2a00640 1 Processor -- start 2024-04-26T21:37:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.049+0000 7fa1e2a00640 1 -- start start 2024-04-26T21:37:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.050+0000 7fa1e2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa1dc0b6d50 0x7fa1dc146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.050+0000 7fa1e2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 0x7fa1dc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.050+0000 7fa1e2a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1dc0b3bb0 con 0x7fa1dc1469c0 2024-04-26T21:37:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.050+0000 7fa1e2a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa1dc070c20 con 0x7fa1dc0b6d50 2024-04-26T21:37:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.050+0000 7fa1e2a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc0b6260 con 0x7fa1dc073d00 2024-04-26T21:37:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.050+0000 7fa1e0c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa1dc1469c0 0x7fa1dc0735f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33920/0 (socket says 172.21.15.5:33920) 2024-04-26T21:37:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.050+0000 7fa1e0c00640 1 -- 172.21.15.5:0/514808085 learned_addr learned my addr 172.21.15.5:0/514808085 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1e2000640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 0x7fa1dc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1e1600640 1 --2- 172.21.15.5:0/514808085 >> v2:172.21.15.112:3300/0 conn(0x7fa1dc0b6d50 0x7fa1dc146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147436849 0 0) 0x7fa1dc0b3bb0 con 0x7fa1dc1469c0 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c4003520 con 0x7fa1dc1469c0 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982749290 0 0) 0x7fa1c4003520 con 0x7fa1dc1469c0 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 msgr2=0x7fa1dc150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 0x7fa1dc150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 >> v2:172.21.15.112:3300/0 conn(0x7fa1dc0b6d50 msgr2=0x7fa1dc146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 --2- 172.21.15.5:0/514808085 >> v2:172.21.15.112:3300/0 conn(0x7fa1dc0b6d50 0x7fa1dc146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc0b7130 con 0x7fa1dc1469c0 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.051+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fa1c8001690 con 0x7fa1dc1469c0 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 >> v1:172.21.15.5:6789/0 conn(0x7fa1dc1469c0 legacy=0x7fa1dc0735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1dbe00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1c40039b0 0x7fa1c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1dbe00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1c4004800 0x7fa1c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1dbe00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 0x7fa1c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc070c20 con 0x7fa1c4004800 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0b6260 con 0x7fa1c40039b0 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c400ba40 con 0x7fa1dc073d00 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e0c00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1c4004800 0x7fa1c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e2000640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 0x7fa1c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e1600640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1c40039b0 0x7fa1c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e0c00640 1 -- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 msgr2=0x7fa1c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e0c00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1dc073d00 0x7fa1c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e0c00640 1 -- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1c40039b0 msgr2=0x7fa1c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e0c00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1c40039b0 0x7fa1c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.052+0000 7fa1e0c00640 1 -- 172.21.15.5:0/514808085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c4003520 con 0x7fa1c4004800 2024-04-26T21:37:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.053+0000 7fa1e0c00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1c4004800 0x7fa1c4004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c210 tx=0x7fa1c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f97fcdd2855350f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c802e070 con 0x7fa1c4004800 2024-04-26T21:37:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c8005ad0 con 0x7fa1c4004800 2024-04-26T21:37:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1dbe00640 1 -- 172.21.15.5:0/514808085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8007d70 con 0x7fa1c4004800 2024-04-26T21:37:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1e2a00640 1 -- 172.21.15.5:0/514808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1c4004800 msgr2=0x7fa1c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1e2a00640 1 --2- 172.21.15.5:0/514808085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1c4004800 0x7fa1c4004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c210 tx=0x7fa1c4005830 comp rx=0 tx=0).stop 2024-04-26T21:37:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1e2000640 1 -- 172.21.15.5:0/514808085 reap_dead start 2024-04-26T21:37:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1e2a00640 1 -- 172.21.15.5:0/514808085 shutdown_connections 2024-04-26T21:37:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.054+0000 7fa1e2a00640 1 -- 172.21.15.5:0/514808085 >> 172.21.15.5:0/514808085 conn(0x7fa1dc06c720 msgr2=0x7fa1dc06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.055+0000 7fa1e2a00640 1 -- 172.21.15.5:0/514808085 shutdown_connections 2024-04-26T21:37:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.055+0000 7fa1e2a00640 1 -- 172.21.15.5:0/514808085 wait complete. 2024-04-26T21:37:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.056+0000 7fa1e2a00640 1 Processor -- start 2024-04-26T21:37:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.056+0000 7fa1e2a00640 1 -- start start 2024-04-26T21:37:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.057+0000 7fa1e2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1c4004800 0x7fa1dc0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.057+0000 7fa1e2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1dc0b2030 0x7fa1dc1ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.057+0000 7fa1e2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1dc1de440 0x7fa1dc1e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.057+0000 7fa1e2a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0b5c40 con 0x7fa1dc0b2030 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.057+0000 7fa1e2a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc070700 con 0x7fa1dc1de440 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.057+0000 7fa1e2a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc0b0cd0 con 0x7fa1c4004800 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.057+0000 7fa1e0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1dc0b2030 0x7fa1dc1ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1dc0b2030 0x7fa1dc1ddf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48338/0 (socket says 172.21.15.5:48338) 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 -- 172.21.15.5:0/337168771 learned_addr learned my addr 172.21.15.5:0/337168771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e1600640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1c4004800 0x7fa1dc0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e2000640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1dc1de440 0x7fa1dc1e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 -- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1c4004800 msgr2=0x7fa1dc0b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1c4004800 0x7fa1dc0b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 -- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1dc1de440 msgr2=0x7fa1dc1e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1dc1de440 0x7fa1dc1e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 -- 172.21.15.5:0/337168771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc1de8c0 con 0x7fa1dc0b2030 2024-04-26T21:37:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e1600640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1c4004800 0x7fa1dc0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.058+0000 7fa1e0c00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1dc0b2030 0x7fa1dc1ddf00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8034040 tx=0x7fa1c8001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.059+0000 7fa1d9600640 1 -- 172.21.15.5:0/337168771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8042070 con 0x7fa1dc0b2030 2024-04-26T21:37:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.059+0000 7fa1d9600640 1 -- 172.21.15.5:0/337168771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c8007480 con 0x7fa1dc0b2030 2024-04-26T21:37:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.059+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc0b30e0 con 0x7fa1dc0b2030 2024-04-26T21:37:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.059+0000 7fa1d9600640 1 -- 172.21.15.5:0/337168771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8007d70 con 0x7fa1dc0b2030 2024-04-26T21:37:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.059+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc0b2740 con 0x7fa1dc0b2030 2024-04-26T21:37:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.060+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1dc075db0 con 0x7fa1dc0b2030 2024-04-26T21:37:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.061+0000 7fa1d9600640 1 -- 172.21.15.5:0/337168771 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1c8045070 con 0x7fa1dc0b2030 2024-04-26T21:37:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.062+0000 7fa1d9600640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.062+0000 7fa1d9600640 1 -- 172.21.15.5:0/337168771 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa1c80abf20 con 0x7fa1dc0b2030 2024-04-26T21:37:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.063+0000 7fa1e1600640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.064+0000 7fa1e1600640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009ad0 tx=0x7fa1d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.067+0000 7fa1d9600640 1 -- 172.21.15.5:0/337168771 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa1c804c070 con 0x7fa1dc0b2030 2024-04-26T21:37:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.270+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa1dc0b2eb0 con 0x7fa1dc0b2030 2024-04-26T21:37:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.271+0000 7fa1d9600640 1 -- 172.21.15.5:0/337168771 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fa1dc1de8c0 con 0x7fa1dc0b2030 2024-04-26T21:37:12.273 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T21:37:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa1bc06c8f0 msgr2=0x7fa1bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009ad0 tx=0x7fa1d0008040 comp rx=0 tx=0).stop 2024-04-26T21:37:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1dc0b2030 msgr2=0x7fa1dc1ddf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1dc0b2030 0x7fa1dc1ddf00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8034040 tx=0x7fa1c8001a60 comp rx=0 tx=0).stop 2024-04-26T21:37:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 shutdown_connections 2024-04-26T21:37:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1dc1de440 0x7fa1dc1e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa1bc06c8f0 0x7fa1bc06edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1dc0b2030 0x7fa1dc1ddf00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 --2- 172.21.15.5:0/337168771 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1c4004800 0x7fa1dc0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 >> 172.21.15.5:0/337168771 conn(0x7fa1dc06c720 msgr2=0x7fa1dc0b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 shutdown_connections 2024-04-26T21:37:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.274+0000 7fa1e2a00640 1 -- 172.21.15.5:0/337168771 wait complete. 2024-04-26T21:37:12.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:37:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.495+0000 7f2996200640 1 Processor -- start 2024-04-26T21:37:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.495+0000 7f2996200640 1 -- start start 2024-04-26T21:37:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.496+0000 7f2996200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29900735d0 0x7f2990073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.496+0000 7f2996200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f299014ed30 0x7f2990151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.496+0000 7f2996200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2990070d90 con 0x7f29900b6d50 2024-04-26T21:37:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f2996200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f29900b0780 con 0x7f29900735d0 2024-04-26T21:37:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f2996200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f29900b7130 con 0x7f299014ed30 2024-04-26T21:37:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f298f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29900b6d50 0x7f2990146480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33936/0 (socket says 172.21.15.5:33936) 2024-04-26T21:37:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f298f400640 1 -- 172.21.15.5:0/2869688363 learned_addr learned my addr 172.21.15.5:0/2869688363 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f2987e00640 1 --2- 172.21.15.5:0/2869688363 >> v2:172.21.15.5:3300/0 conn(0x7f29900735d0 0x7f2990073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f298fe00640 1 --2- 172.21.15.5:0/2869688363 >> v2:172.21.15.112:3300/0 conn(0x7f299014ed30 0x7f2990151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f2987e00640 1 -- 172.21.15.5:0/2869688363 >> v2:172.21.15.112:3300/0 conn(0x7f299014ed30 msgr2=0x7f2990151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f2987e00640 1 --2- 172.21.15.5:0/2869688363 >> v2:172.21.15.112:3300/0 conn(0x7f299014ed30 0x7f2990151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f2987e00640 1 -- 172.21.15.5:0/2869688363 >> v1:172.21.15.5:6789/0 conn(0x7f29900b6d50 legacy=0x7f2990146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f2987e00640 1 -- 172.21.15.5:0/2869688363 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29900b0a20 con 0x7f29900735d0 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.497+0000 7f298ea00640 1 -- 172.21.15.5:0/2869688363 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573380735 0 0) 0x7f2990070d90 con 0x7f29900b6d50 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.498+0000 7f2987e00640 1 --2- 172.21.15.5:0/2869688363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29900735d0 0x7f2990073a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29900714d0 tx=0x7f297802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce4e4017ad70c39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f298ea00640 1 -- 172.21.15.5:0/2869688363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978037070 con 0x7f29900735d0 2024-04-26T21:37:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f298ea00640 1 -- 172.21.15.5:0/2869688363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297802add0 con 0x7f29900735d0 2024-04-26T21:37:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f298ea00640 1 -- 172.21.15.5:0/2869688363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978032660 con 0x7f29900735d0 2024-04-26T21:37:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f2996200640 1 -- 172.21.15.5:0/2869688363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29900735d0 msgr2=0x7f2990073a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f2996200640 1 --2- 172.21.15.5:0/2869688363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29900735d0 0x7f2990073a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29900714d0 tx=0x7f297802a080 comp rx=0 tx=0).stop 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f2996200640 1 -- 172.21.15.5:0/2869688363 shutdown_connections 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f2996200640 1 --2- 172.21.15.5:0/2869688363 >> v2:172.21.15.112:3300/0 conn(0x7f299014ed30 0x7f2990151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f2996200640 1 --2- 172.21.15.5:0/2869688363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29900735d0 0x7f2990073a30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.499+0000 7f2996200640 1 -- 172.21.15.5:0/2869688363 >> 172.21.15.5:0/2869688363 conn(0x7f299006c720 msgr2=0x7f299006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.500+0000 7f2996200640 1 -- 172.21.15.5:0/2869688363 shutdown_connections 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.500+0000 7f2996200640 1 -- 172.21.15.5:0/2869688363 wait complete. 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.501+0000 7f2996200640 1 Processor -- start 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.501+0000 7f2996200640 1 -- start start 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f2996200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29900735d0 0x7f29900afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f2996200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29900b6d50 0x7f29900b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f2996200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299014ed30 0x7f29900b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f2996200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29900b3bf0 con 0x7f299014ed30 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f2996200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2990070870 con 0x7f29900735d0 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f2996200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f29900b4050 con 0x7f29900b6d50 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f298fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299014ed30 0x7f29900b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f298fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299014ed30 0x7f29900b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48356/0 (socket says 172.21.15.5:48356) 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.502+0000 7f298fe00640 1 -- 172.21.15.5:0/169887210 learned_addr learned my addr 172.21.15.5:0/169887210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f2987e00640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29900b6d50 0x7f29900b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f298f400640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29900735d0 0x7f29900afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f298fe00640 1 -- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29900b6d50 msgr2=0x7f29900b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f298fe00640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29900b6d50 0x7f29900b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f298fe00640 1 -- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29900735d0 msgr2=0x7f29900afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f298fe00640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29900735d0 0x7f29900afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f298fe00640 1 -- 172.21.15.5:0/169887210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29901e1a00 con 0x7f299014ed30 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.503+0000 7f298fe00640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299014ed30 0x7f29900b8760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2988009fd0 tx=0x7f298800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.504+0000 7f2987400640 1 -- 172.21.15.5:0/169887210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988014420 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.504+0000 7f2987400640 1 -- 172.21.15.5:0/169887210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2988019070 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.504+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29900b10c0 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.504+0000 7f2987400640 1 -- 172.21.15.5:0/169887210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988014800 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.504+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29901e1ca0 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.505+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29901e1830 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.506+0000 7f2987400640 1 -- 172.21.15.5:0/169887210 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29880149a0 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.507+0000 7f2987400640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f296c06c920 0x7f296c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.507+0000 7f2987400640 1 -- 172.21.15.5:0/169887210 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f298808bff0 con 0x7f299014ed30 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.508+0000 7f298f400640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f296c06c920 0x7f296c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.509+0000 7f298f400640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f296c06c920 0x7f296c06ede0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2980000f60 tx=0x7f2980007b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.512+0000 7f2987400640 1 -- 172.21.15.5:0/169887210 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f298805a780 con 0x7f299014ed30 2024-04-26T21:37:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.760+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2990075db0 con 0x7f299014ed30 2024-04-26T21:37:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.761+0000 7f2987400640 1 -- 172.21.15.5:0/169887210 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2216 (secure 0 0 0) 0x7f298805a080 con 0x7f299014ed30 2024-04-26T21:37:12.762 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:12.763 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T21:37:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-04-26T21:37:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f296c06c920 msgr2=0x7f296c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f296c06c920 0x7f296c06ede0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2980000f60 tx=0x7f2980007b50 comp rx=0 tx=0).stop 2024-04-26T21:37:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299014ed30 msgr2=0x7f29900b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299014ed30 0x7f29900b8760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2988009fd0 tx=0x7f298800e4b0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 shutdown_connections 2024-04-26T21:37:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f296c06c920 0x7f296c06ede0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299014ed30 0x7f29900b8760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29900b6d50 0x7f29900b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 --2- 172.21.15.5:0/169887210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29900735d0 0x7f29900afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 >> 172.21.15.5:0/169887210 conn(0x7f299006c720 msgr2=0x7f299013e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 shutdown_connections 2024-04-26T21:37:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.764+0000 7f2996200640 1 -- 172.21.15.5:0/169887210 wait complete. 2024-04-26T21:37:12.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:12.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:37:12.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:37:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.979+0000 7efda5600640 1 Processor -- start 2024-04-26T21:37:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.980+0000 7efda5600640 1 -- start start 2024-04-26T21:37:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.981+0000 7efda5600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efda00b6d50 0x7efda00b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.981+0000 7efda5600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.981+0000 7efda5600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda00b7130 con 0x7efda014bcc0 2024-04-26T21:37:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.981+0000 7efda5600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efda00b0070 con 0x7efda00b6d50 2024-04-26T21:37:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.981+0000 7efda5600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efda00af490 con 0x7efda01494e0 2024-04-26T21:37:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.982+0000 7efd9f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.982+0000 7efd9f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda014c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:47018/0 (socket says 172.21.15.5:47018) 2024-04-26T21:37:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.982+0000 7efd9f400640 1 -- 172.21.15.5:0/3260983488 learned_addr learned my addr 172.21.15.5:0/3260983488 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.982+0000 7efd9ea00640 1 --2- 172.21.15.5:0/3260983488 >> v2:172.21.15.112:3300/0 conn(0x7efda00b6d50 0x7efda00b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.982+0000 7efd9f400640 1 -- 172.21.15.5:0/3260983488 >> v2:172.21.15.112:3300/0 conn(0x7efda00b6d50 msgr2=0x7efda00b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.982+0000 7efd9f400640 1 --2- 172.21.15.5:0/3260983488 >> v2:172.21.15.112:3300/0 conn(0x7efda00b6d50 0x7efda00b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.982+0000 7efd9f400640 1 -- 172.21.15.5:0/3260983488 >> v1:172.21.15.112:6789/0 conn(0x7efda014bcc0 legacy=0x7efda0148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.983+0000 7efd9f400640 1 -- 172.21.15.5:0/3260983488 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda00aec60 con 0x7efda01494e0 2024-04-26T21:37:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.984+0000 7efd9f400640 1 --2- 172.21.15.5:0/3260983488 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda014c0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd98009e50 tx=0x7efd9802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21aab85697ae3256 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.984+0000 7efd9d600640 1 -- 172.21.15.5:0/3260983488 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98036070 con 0x7efda01494e0 2024-04-26T21:37:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.984+0000 7efd9d600640 1 -- 172.21.15.5:0/3260983488 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98031600 con 0x7efda01494e0 2024-04-26T21:37:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.984+0000 7efd9d600640 1 -- 172.21.15.5:0/3260983488 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd980319d0 con 0x7efda01494e0 2024-04-26T21:37:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 -- 172.21.15.5:0/3260983488 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 msgr2=0x7efda014c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 --2- 172.21.15.5:0/3260983488 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda014c0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd98009e50 tx=0x7efd9802a5f0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 -- 172.21.15.5:0/3260983488 shutdown_connections 2024-04-26T21:37:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 --2- 172.21.15.5:0/3260983488 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda014c0f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 --2- 172.21.15.5:0/3260983488 >> v2:172.21.15.112:3300/0 conn(0x7efda00b6d50 0x7efda00b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 -- 172.21.15.5:0/3260983488 >> 172.21.15.5:0/3260983488 conn(0x7efda006c720 msgr2=0x7efda006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 -- 172.21.15.5:0/3260983488 shutdown_connections 2024-04-26T21:37:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.985+0000 7efda5600640 1 -- 172.21.15.5:0/3260983488 wait complete. 2024-04-26T21:37:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.987+0000 7efda5600640 1 Processor -- start 2024-04-26T21:37:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.987+0000 7efda5600640 1 -- start start 2024-04-26T21:37:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.988+0000 7efda5600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda00b6d50 0x7efda01e1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.988+0000 7efda5600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda01e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.988+0000 7efda5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda014bcc0 0x7efda013b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.988+0000 7efda5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efda00ae990 con 0x7efda014bcc0 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.988+0000 7efda5600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efda00ae810 con 0x7efda00b6d50 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.988+0000 7efda5600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efda0152ff0 con 0x7efda01494e0 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda014bcc0 0x7efda013b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda014bcc0 0x7efda013b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48364/0 (socket says 172.21.15.5:48364) 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 -- 172.21.15.5:0/2315160671 learned_addr learned my addr 172.21.15.5:0/2315160671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9ea00640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda00b6d50 0x7efda01e1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9e000640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda01e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 -- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 msgr2=0x7efda01e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda01e20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 -- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda00b6d50 msgr2=0x7efda01e1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda00b6d50 0x7efda01e1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9f400640 1 -- 172.21.15.5:0/2315160671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda013d3b0 con 0x7efda014bcc0 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.989+0000 7efd9ea00640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda00b6d50 0x7efda01e1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.990+0000 7efd9f400640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda014bcc0 0x7efda013b940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efd98009e50 tx=0x7efd98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.990+0000 7efd96a00640 1 -- 172.21.15.5:0/2315160671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98041020 con 0x7efda014bcc0 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.990+0000 7efd96a00640 1 -- 172.21.15.5:0/2315160671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd980086b0 con 0x7efda014bcc0 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.990+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda0140220 con 0x7efda014bcc0 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.990+0000 7efd96a00640 1 -- 172.21.15.5:0/2315160671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98036040 con 0x7efda014bcc0 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.990+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda013ff40 con 0x7efda014bcc0 2024-04-26T21:37:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.991+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda00b9920 con 0x7efda014bcc0 2024-04-26T21:37:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.992+0000 7efd96a00640 1 -- 172.21.15.5:0/2315160671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd98044020 con 0x7efda014bcc0 2024-04-26T21:37:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.993+0000 7efd96a00640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efd8006c8f0 0x7efd8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.993+0000 7efd96a00640 1 -- 172.21.15.5:0/2315160671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efd980ac620 con 0x7efda014bcc0 2024-04-26T21:37:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.994+0000 7efd9ea00640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efd8006c8f0 0x7efd8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.995+0000 7efd9ea00640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efd8006c8f0 0x7efd8006edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd90009b90 tx=0x7efd90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:12.998+0000 7efd96a00640 1 -- 172.21.15.5:0/2315160671 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efd9804b030 con 0x7efda014bcc0 2024-04-26T21:37:13.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.210+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efda0075db0 con 0x7efda014bcc0 2024-04-26T21:37:13.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.212+0000 7efd96a00640 1 -- 172.21.15.5:0/2315160671 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12812 (secure 0 0 0) 0x7efd9807ad10 con 0x7efda014bcc0 2024-04-26T21:37:13.214 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:13.214 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:07.740395+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.215+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efd8006c8f0 msgr2=0x7efd8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.215+0000 7efda5600640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efd8006c8f0 0x7efd8006edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd90009b90 tx=0x7efd90008040 comp rx=0 tx=0).stop 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.215+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda014bcc0 msgr2=0x7efda013b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.215+0000 7efda5600640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda014bcc0 0x7efda013b940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efd98009e50 tx=0x7efd98004a40 comp rx=0 tx=0).stop 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 shutdown_connections 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efd8006c8f0 0x7efd8006edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda014bcc0 0x7efda013b940 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efda01494e0 0x7efda01e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 --2- 172.21.15.5:0/2315160671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efda00b6d50 0x7efda01e1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 >> 172.21.15.5:0/2315160671 conn(0x7efda006c720 msgr2=0x7efda014ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 shutdown_connections 2024-04-26T21:37:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.216+0000 7efda5600640 1 -- 172.21.15.5:0/2315160671 wait complete. 2024-04-26T21:37:13.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:37:13.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:37:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.498+0000 7f5dcc400640 1 Processor -- start 2024-04-26T21:37:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.498+0000 7f5dcc400640 1 -- start start 2024-04-26T21:37:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dcc400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc40b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dcc400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5dc41401f0 0x7f5dc4140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dcc400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5dc40aecd0 0x7f5dc40af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dcc400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc40b3bb0 con 0x7f5dc41401f0 2024-04-26T21:37:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dcc400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc406eb60 con 0x7f5dc40aecd0 2024-04-26T21:37:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dcc400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc40b3440 con 0x7f5dc406e780 2024-04-26T21:37:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dc9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5dc41401f0 0x7f5dc4140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dc9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5dc41401f0 0x7f5dc4140650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48366/0 (socket says 172.21.15.5:48366) 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.500+0000 7f5dc9000640 1 -- 172.21.15.5:0/4102156370 learned_addr learned my addr 172.21.15.5:0/4102156370 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.501+0000 7f5dc9a00640 1 --2- 172.21.15.5:0/4102156370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc40b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.501+0000 7f5dca400640 1 --2- 172.21.15.5:0/4102156370 >> v2:172.21.15.112:3300/0 conn(0x7f5dc40aecd0 0x7f5dc40af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.501+0000 7f5dc9000640 1 -- 172.21.15.5:0/4102156370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 msgr2=0x7f5dc40b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.501+0000 7f5dc9000640 1 --2- 172.21.15.5:0/4102156370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc40b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.501+0000 7f5dc9000640 1 -- 172.21.15.5:0/4102156370 >> v2:172.21.15.112:3300/0 conn(0x7f5dc40aecd0 msgr2=0x7f5dc40af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.501+0000 7f5dc9000640 1 --2- 172.21.15.5:0/4102156370 >> v2:172.21.15.112:3300/0 conn(0x7f5dc40aecd0 0x7f5dc40af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.501+0000 7f5dc9000640 1 -- 172.21.15.5:0/4102156370 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc40b11b0 con 0x7f5dc41401f0 2024-04-26T21:37:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.504+0000 7f5dc9000640 1 --2- 172.21.15.5:0/4102156370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc41401f0 0x7f5dc4140650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4074910 tx=0x7f5db002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea34a320a2ecf5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.504+0000 7f5dc3e00640 1 -- 172.21.15.5:0/4102156370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0037070 con 0x7f5dc41401f0 2024-04-26T21:37:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.504+0000 7f5dc3e00640 1 -- 172.21.15.5:0/4102156370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db0032440 con 0x7f5dc41401f0 2024-04-26T21:37:13.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.504+0000 7f5dc3e00640 1 -- 172.21.15.5:0/4102156370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0032810 con 0x7f5dc41401f0 2024-04-26T21:37:13.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 -- 172.21.15.5:0/4102156370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc41401f0 msgr2=0x7f5dc4140650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 --2- 172.21.15.5:0/4102156370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc41401f0 0x7f5dc4140650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4074910 tx=0x7f5db002a140 comp rx=0 tx=0).stop 2024-04-26T21:37:13.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 -- 172.21.15.5:0/4102156370 shutdown_connections 2024-04-26T21:37:13.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 --2- 172.21.15.5:0/4102156370 >> v2:172.21.15.112:3300/0 conn(0x7f5dc40aecd0 0x7f5dc40af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 --2- 172.21.15.5:0/4102156370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc41401f0 0x7f5dc4140650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 --2- 172.21.15.5:0/4102156370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc40b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 -- 172.21.15.5:0/4102156370 >> 172.21.15.5:0/4102156370 conn(0x7f5dc40b7bb0 msgr2=0x7f5dc40b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:13.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 -- 172.21.15.5:0/4102156370 shutdown_connections 2024-04-26T21:37:13.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.505+0000 7f5dcc400640 1 -- 172.21.15.5:0/4102156370 wait complete. 2024-04-26T21:37:13.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.507+0000 7f5dcc400640 1 Processor -- start 2024-04-26T21:37:13.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.507+0000 7f5dcc400640 1 -- start start 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dcc400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc4146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dcc400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc40aecd0 0x7f5dc41e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dcc400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dc406d540 0x7f5dc4143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dcc400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc40b30c0 con 0x7f5dc40aecd0 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dcc400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc4140b90 con 0x7f5dc406d540 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dcc400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc40b4090 con 0x7f5dc406e780 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc40aecd0 0x7f5dc41e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc40aecd0 0x7f5dc41e1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48374/0 (socket says 172.21.15.5:48374) 2024-04-26T21:37:13.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 -- 172.21.15.5:0/1343973965 learned_addr learned my addr 172.21.15.5:0/1343973965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9a00640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc4146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 -- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 msgr2=0x7f5dc4146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc4146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 -- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dc406d540 msgr2=0x7f5dc4143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dc406d540 0x7f5dc4143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.508+0000 7f5dc9000640 1 -- 172.21.15.5:0/1343973965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc41e2350 con 0x7f5dc40aecd0 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.509+0000 7f5dc9000640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc40aecd0 0x7f5dc41e1e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5db0035040 tx=0x7f5db00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.509+0000 7f5dc1600640 1 -- 172.21.15.5:0/1343973965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0037040 con 0x7f5dc40aecd0 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.509+0000 7f5dc1600640 1 -- 172.21.15.5:0/1343973965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db0004230 con 0x7f5dc40aecd0 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.509+0000 7f5dc1600640 1 -- 172.21.15.5:0/1343973965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0003610 con 0x7f5dc40aecd0 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.509+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc406c9f0 con 0x7f5dc40aecd0 2024-04-26T21:37:13.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.509+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc4147390 con 0x7f5dc40aecd0 2024-04-26T21:37:13.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.510+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc409fc90 con 0x7f5dc40aecd0 2024-04-26T21:37:13.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.511+0000 7f5dc1600640 1 -- 172.21.15.5:0/1343973965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5db00037b0 con 0x7f5dc40aecd0 2024-04-26T21:37:13.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.512+0000 7f5dc1600640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5da406c8f0 0x7f5da406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.512+0000 7f5dc1600640 1 -- 172.21.15.5:0/1343973965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5db00ac300 con 0x7f5dc40aecd0 2024-04-26T21:37:13.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.513+0000 7f5dc9a00640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5da406c8f0 0x7f5da406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.514+0000 7f5dc9a00640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5da406c8f0 0x7f5da406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5db8006fd0 tx=0x7f5db8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:13.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.518+0000 7f5dc1600640 1 -- 172.21.15.5:0/1343973965 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5dc409fc90 con 0x7f5dc40aecd0 2024-04-26T21:37:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.719+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5dc4075db0 con 0x7f5dc40aecd0 2024-04-26T21:37:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.720+0000 7f5dc1600640 1 -- 172.21.15.5:0/1343973965 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f5db007aa70 con 0x7f5dc40aecd0 2024-04-26T21:37:13.721 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T21:37:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5da406c8f0 msgr2=0x7f5da406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5da406c8f0 0x7f5da406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5db8006fd0 tx=0x7f5db8008040 comp rx=0 tx=0).stop 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc40aecd0 msgr2=0x7f5dc41e1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc40aecd0 0x7f5dc41e1e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5db0035040 tx=0x7f5db00046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 shutdown_connections 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dc406d540 0x7f5dc4143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5da406c8f0 0x7f5da406edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc40aecd0 0x7f5dc41e1e10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 --2- 172.21.15.5:0/1343973965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5dc406e780 0x7f5dc4146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 >> 172.21.15.5:0/1343973965 conn(0x7f5dc40b7bb0 msgr2=0x7f5dc40b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 shutdown_connections 2024-04-26T21:37:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.723+0000 7f5dcc400640 1 -- 172.21.15.5:0/1343973965 wait complete. 2024-04-26T21:37:13.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T21:37:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.950+0000 7f36ff200640 1 Processor -- start 2024-04-26T21:37:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.950+0000 7f36ff200640 1 -- start start 2024-04-26T21:37:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36ff200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 0x7f36f81421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36ff200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80bb270 con 0x7f36f8142700 2024-04-26T21:37:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36ff200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80b7a00 con 0x7f36f814c250 2024-04-26T21:37:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36ff200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80ba590 con 0x7f36f80bae90 2024-04-26T21:37:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36fd400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f36f8142700 0x7f36f814bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33950/0 (socket says 172.21.15.5:33950) 2024-04-26T21:37:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36fd400640 1 -- 172.21.15.5:0/2974555250 learned_addr learned my addr 172.21.15.5:0/2974555250 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36fde00640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 0x7f36f81421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.952+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794615227 0 0) 0x7f36f80bb270 con 0x7f36f8142700 2024-04-26T21:37:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36e0003520 con 0x7f36f8142700 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 922606086 0 0) 0x7f36e0003520 con 0x7f36f8142700 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 msgr2=0x7f36f81421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 0x7f36f81421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 >> v1:172.21.15.112:6789/0 conn(0x7f36f814c250 legacy=0x7f36f8152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80ba2b0 con 0x7f36f8142700 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f36e8001670 con 0x7f36f8142700 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 >> v1:172.21.15.5:6789/0 conn(0x7f36f8142700 legacy=0x7f36f814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 0x7f36e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e0003fb0 0x7f36e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80ba590 con 0x7f36e0004d40 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36e000bbb0 con 0x7f36e0003fb0 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f36e000bdb0 con 0x7f36f80bae90 2024-04-26T21:37:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.953+0000 7f36fe800640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fde00640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 0x7f36e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fd400640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e0003fb0 0x7f36e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fe800640 1 -- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 msgr2=0x7f36e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fe800640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f80bae90 0x7f36e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fe800640 1 -- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e0003fb0 msgr2=0x7f36e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fe800640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e0003fb0 0x7f36e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fe800640 1 -- 172.21.15.5:0/2974555250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e0003520 con 0x7f36e0004d40 2024-04-26T21:37:13.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.954+0000 7f36fd400640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36e0003fb0 0x7f36e0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.955+0000 7f36fe800640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36e00051c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f36f4001e50 tx=0x7f36e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282aa77370052e63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.955+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4001a70 con 0x7f36e0004d40 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.955+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f4003970 con 0x7f36e0004d40 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.955+0000 7f36fca00640 1 -- 172.21.15.5:0/2974555250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4003d60 con 0x7f36e0004d40 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.956+0000 7f36ff200640 1 -- 172.21.15.5:0/2974555250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 msgr2=0x7f36e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.956+0000 7f36ff200640 1 --2- 172.21.15.5:0/2974555250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36e00051c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f36f4001e50 tx=0x7f36e0005830 comp rx=0 tx=0).stop 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.956+0000 7f36fe800640 1 -- 172.21.15.5:0/2974555250 reap_dead start 2024-04-26T21:37:13.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.956+0000 7f36ff200640 1 -- 172.21.15.5:0/2974555250 shutdown_connections 2024-04-26T21:37:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.956+0000 7f36ff200640 1 -- 172.21.15.5:0/2974555250 >> 172.21.15.5:0/2974555250 conn(0x7f36f80684e0 msgr2=0x7f36f80688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.956+0000 7f36ff200640 1 -- 172.21.15.5:0/2974555250 shutdown_connections 2024-04-26T21:37:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.956+0000 7f36ff200640 1 -- 172.21.15.5:0/2974555250 wait complete. 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.958+0000 7f36ff200640 1 Processor -- start 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.958+0000 7f36ff200640 1 -- start start 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.958+0000 7f36ff200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36f813bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.958+0000 7f36ff200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f813def0 0x7f36f81e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36ff200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f81e1c10 0x7f36f8137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36ff200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80b6330 con 0x7f36e0004d40 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36ff200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80b6a30 con 0x7f36f81e1c10 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36ff200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80b75d0 con 0x7f36f813def0 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36f813bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36f813bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48384/0 (socket says 172.21.15.5:48384) 2024-04-26T21:37:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 -- 172.21.15.5:0/455104956 learned_addr learned my addr 172.21.15.5:0/455104956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fd400640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f813def0 0x7f36f81e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 -- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f813def0 msgr2=0x7f36f81e16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fe800640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f81e1c10 0x7f36f8137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f813def0 0x7f36f81e16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 -- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f81e1c10 msgr2=0x7f36f8137a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f81e1c10 0x7f36f8137a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.959+0000 7f36fde00640 1 -- 172.21.15.5:0/455104956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f813e6b0 con 0x7f36e0004d40 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.960+0000 7f36fde00640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36f813bf30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36ec011600 tx=0x7f36ec011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.960+0000 7f36f2000640 1 -- 172.21.15.5:0/455104956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00f920 con 0x7f36e0004d40 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.960+0000 7f36f2000640 1 -- 172.21.15.5:0/455104956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec00fac0 con 0x7f36e0004d40 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.960+0000 7f36f2000640 1 -- 172.21.15.5:0/455104956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00fe70 con 0x7f36e0004d40 2024-04-26T21:37:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.960+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f813cac0 con 0x7f36e0004d40 2024-04-26T21:37:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.960+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f813e350 con 0x7f36e0004d40 2024-04-26T21:37:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.961+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f8075db0 con 0x7f36e0004d40 2024-04-26T21:37:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.962+0000 7f36f2000640 1 -- 172.21.15.5:0/455104956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f36ec015460 con 0x7f36e0004d40 2024-04-26T21:37:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.964+0000 7f36f2000640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f36dc06c8f0 0x7f36dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.964+0000 7f36f2000640 1 -- 172.21.15.5:0/455104956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f36ec08c200 con 0x7f36e0004d40 2024-04-26T21:37:13.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.964+0000 7f36fd400640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f36dc06c8f0 0x7f36dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:13.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.965+0000 7f36fd400640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f36dc06c8f0 0x7f36dc06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f36f81df020 tx=0x7f36e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:13.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:13.968+0000 7f36f2000640 1 -- 172.21.15.5:0/455104956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f36ec019030 con 0x7f36e0004d40 2024-04-26T21:37:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.174+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f36f813fe60 con 0x7f36e0004d40 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.175+0000 7f36f2000640 1 -- 172.21.15.5:0/455104956 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f36ec05a970 con 0x7f36e0004d40 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-26T21:37:14.176 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-26T21:37:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f36dc06c8f0 msgr2=0x7f36dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f36dc06c8f0 0x7f36dc06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f36f81df020 tx=0x7f36e8009040 comp rx=0 tx=0).stop 2024-04-26T21:37:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 msgr2=0x7f36f813bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36f813bf30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36ec011600 tx=0x7f36ec011ac0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 shutdown_connections 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36f81e1c10 0x7f36f8137a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36f813def0 0x7f36f81e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f36dc06c8f0 0x7f36dc06edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 --2- 172.21.15.5:0/455104956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0004d40 0x7f36f813bf30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 >> 172.21.15.5:0/455104956 conn(0x7f36f80684e0 msgr2=0x7f36f80b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.177+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 shutdown_connections 2024-04-26T21:37:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.178+0000 7f36ff200640 1 -- 172.21.15.5:0/455104956 wait complete. 2024-04-26T21:37:14.198 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T21:37:14.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T21:37:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.415+0000 7f2b93200640 1 Processor -- start 2024-04-26T21:37:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.415+0000 7f2b93200640 1 -- start start 2024-04-26T21:37:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b93200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b941407c0 0x7f2b94151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b93200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b9406d960 con 0x7f2b9406d580 2024-04-26T21:37:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b93200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b94071c90 con 0x7f2b94070a70 2024-04-26T21:37:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b93200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2b940719b0 con 0x7f2b941407c0 2024-04-26T21:37:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b91e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b9406d580 0x7f2b94146bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55742/0 (socket says 172.21.15.5:55742) 2024-04-26T21:37:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b91e00640 1 -- 172.21.15.5:0/2157734797 learned_addr learned my addr 172.21.15.5:0/2157734797 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b92800640 1 --2- 172.21.15.5:0/2157734797 >> v2:172.21.15.112:3300/0 conn(0x7f2b941407c0 0x7f2b94151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885416796 0 0) 0x7f2b9406d960 con 0x7f2b9406d580 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.417+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b78003520 con 0x7f2b9406d580 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2436922141 0 0) 0x7f2b78003520 con 0x7f2b9406d580 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 >> v2:172.21.15.112:3300/0 conn(0x7f2b941407c0 msgr2=0x7f2b94151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 --2- 172.21.15.5:0/2157734797 >> v2:172.21.15.112:3300/0 conn(0x7f2b941407c0 0x7f2b94151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 >> v1:172.21.15.112:6789/0 conn(0x7f2b94070a70 legacy=0x7f2b941400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b940b6160 con 0x7f2b9406d580 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f2b84001670 con 0x7f2b9406d580 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 >> v1:172.21.15.5:6789/0 conn(0x7f2b9406d580 legacy=0x7f2b94146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b78003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b78004800 0x7f2b78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b78005210 0x7f2b7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940719b0 con 0x7f2b78003a00 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7800c160 con 0x7f2b78005210 2024-04-26T21:37:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7800c360 con 0x7f2b78004800 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.418+0000 7f2b91e00640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b78003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b92800640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b78005210 0x7f2b7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b91400640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b78004800 0x7f2b78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b91e00640 1 -- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b78004800 msgr2=0x7f2b78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b91e00640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b78004800 0x7f2b78004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b91e00640 1 -- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b78005210 msgr2=0x7f2b7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b91e00640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b78005210 0x7f2b7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b91e00640 1 -- 172.21.15.5:0/2157734797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b78003520 con 0x7f2b78003a00 2024-04-26T21:37:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.419+0000 7f2b92800640 1 -- 172.21.15.5:0/2157734797 reap_dead start 2024-04-26T21:37:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.420+0000 7f2b91e00640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b78003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b84007fd0 tx=0x7f2b78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3760cfde8ec77f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.420+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84007c20 con 0x7f2b78003a00 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.420+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b84005af0 con 0x7f2b78003a00 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.420+0000 7f2b90a00640 1 -- 172.21.15.5:0/2157734797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84007070 con 0x7f2b78003a00 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.421+0000 7f2b93200640 1 -- 172.21.15.5:0/2157734797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 msgr2=0x7f2b78003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.421+0000 7f2b93200640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b78003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b84007fd0 tx=0x7f2b78005830 comp rx=0 tx=0).stop 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.421+0000 7f2b93200640 1 -- 172.21.15.5:0/2157734797 shutdown_connections 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.421+0000 7f2b93200640 1 --2- 172.21.15.5:0/2157734797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b78003e20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.421+0000 7f2b93200640 1 -- 172.21.15.5:0/2157734797 >> 172.21.15.5:0/2157734797 conn(0x7f2b940b6550 msgr2=0x7f2b940b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.421+0000 7f2b93200640 1 -- 172.21.15.5:0/2157734797 shutdown_connections 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.421+0000 7f2b93200640 1 -- 172.21.15.5:0/2157734797 wait complete. 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.422+0000 7f2b93200640 1 Processor -- start 2024-04-26T21:37:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.423+0000 7f2b93200640 1 -- start start 2024-04-26T21:37:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.423+0000 7f2b93200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b9413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b93200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b9413e580 0x7f2b941de710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b93200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b9413c7e0 0x7f2b9413cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b93200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940b4450 con 0x7f2b78003a00 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b93200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94146380 con 0x7f2b9413e580 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b93200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2b940b3e00 con 0x7f2b9413c7e0 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b9413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b9413f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40724/0 (socket says 172.21.15.5:40724) 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 -- 172.21.15.5:0/1975996570 learned_addr learned my addr 172.21.15.5:0/1975996570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b92800640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b9413c7e0 0x7f2b9413cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91400640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b9413e580 0x7f2b941de710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 -- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b9413c7e0 msgr2=0x7f2b9413cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b9413c7e0 0x7f2b9413cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 -- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b9413e580 msgr2=0x7f2b941de710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b9413e580 0x7f2b941de710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.424+0000 7f2b91e00640 1 -- 172.21.15.5:0/1975996570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9413ea90 con 0x7f2b78003a00 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.425+0000 7f2b91e00640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b9413f500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400c1d0 tx=0x7f2b940b6330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.425+0000 7f2b8a000640 1 -- 172.21.15.5:0/1975996570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84041020 con 0x7f2b78003a00 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.425+0000 7f2b8a000640 1 -- 172.21.15.5:0/1975996570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b84038040 con 0x7f2b78003a00 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.425+0000 7f2b8a000640 1 -- 172.21.15.5:0/1975996570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84001670 con 0x7f2b78003a00 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.425+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9413ed70 con 0x7f2b78003a00 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.425+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b940b7e40 con 0x7f2b78003a00 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.426+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b940b4140 con 0x7f2b78003a00 2024-04-26T21:37:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.427+0000 7f2b8a000640 1 -- 172.21.15.5:0/1975996570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b84044020 con 0x7f2b78003a00 2024-04-26T21:37:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.429+0000 7f2b8a000640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2b7406c8f0 0x7f2b7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.429+0000 7f2b8a000640 1 -- 172.21.15.5:0/1975996570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2b840abc30 con 0x7f2b78003a00 2024-04-26T21:37:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.429+0000 7f2b91400640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2b7406c8f0 0x7f2b7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.430+0000 7f2b91400640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2b7406c8f0 0x7f2b7406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b94074040 tx=0x7f2b80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:14.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.434+0000 7f2b8a000640 1 -- 172.21.15.5:0/1975996570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2b940b4140 con 0x7f2b78003a00 2024-04-26T21:37:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:14.637+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2b940743f0 con 0x7f2b78003a00 2024-04-26T21:37:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.384+0000 7f2b8a000640 1 -- 172.21.15.5:0/1975996570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f2b940743f0 con 0x7f2b78003a00 2024-04-26T21:37:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2b7406c8f0 msgr2=0x7f2b7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2b7406c8f0 0x7f2b7406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b94074040 tx=0x7f2b80009040 comp rx=0 tx=0).stop 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 msgr2=0x7f2b9413f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b9413f500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400c1d0 tx=0x7f2b940b6330 comp rx=0 tx=0).stop 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 shutdown_connections 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b9413c7e0 0x7f2b9413cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b9413e580 0x7f2b941de710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2b7406c8f0 0x7f2b7406edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 --2- 172.21.15.5:0/1975996570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b78003a00 0x7f2b9413f500 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.388+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 >> 172.21.15.5:0/1975996570 conn(0x7f2b940b6550 msgr2=0x7f2b940af290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.389+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 shutdown_connections 2024-04-26T21:37:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.389+0000 7f2b93200640 1 -- 172.21.15.5:0/1975996570 wait complete. 2024-04-26T21:37:15.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T21:37:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.620+0000 7f101b800640 1 Processor -- start 2024-04-26T21:37:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.621+0000 7f101b800640 1 -- start start 2024-04-26T21:37:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.622+0000 7f101b800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1014150570 0x7f101406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.622+0000 7f101b800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10140b28e0 0x7f1014150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.622+0000 7f101b800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10140b14f0 con 0x7f1014150950 2024-04-26T21:37:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.622+0000 7f101b800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f101406c4c0 con 0x7f10140b28e0 2024-04-26T21:37:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.622+0000 7f101b800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f10140b1cb0 con 0x7f1014150570 2024-04-26T21:37:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.622+0000 7f1013e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1014150950 0x7f10140b21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55752/0 (socket says 172.21.15.5:55752) 2024-04-26T21:37:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.622+0000 7f1013e00640 1 -- 172.21.15.5:0/1584259076 learned_addr learned my addr 172.21.15.5:0/1584259076 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1018e00640 1 --2- 172.21.15.5:0/1584259076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1014150570 0x7f101406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1019800640 1 --2- 172.21.15.5:0/1584259076 >> v2:172.21.15.112:3300/0 conn(0x7f10140b28e0 0x7f1014150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1013400640 1 -- 172.21.15.5:0/1584259076 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365343947 0 0) 0x7f10140b14f0 con 0x7f1014150950 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1013400640 1 -- 172.21.15.5:0/1584259076 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ffc003520 con 0x7f1014150950 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1018e00640 1 -- 172.21.15.5:0/1584259076 >> v2:172.21.15.112:3300/0 conn(0x7f10140b28e0 msgr2=0x7f1014150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1018e00640 1 --2- 172.21.15.5:0/1584259076 >> v2:172.21.15.112:3300/0 conn(0x7f10140b28e0 0x7f1014150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1018e00640 1 -- 172.21.15.5:0/1584259076 >> v1:172.21.15.5:6789/0 conn(0x7f1014150950 legacy=0x7f10140b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.623+0000 7f1018e00640 1 -- 172.21.15.5:0/1584259076 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10140b1980 con 0x7f1014150570 2024-04-26T21:37:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.625+0000 7f1018e00640 1 --2- 172.21.15.5:0/1584259076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1014150570 0x7f101406eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10080097a0 tx=0x7f100802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=644e8aae2faccf6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.625+0000 7f1013400640 1 -- 172.21.15.5:0/1584259076 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008037070 con 0x7f1014150570 2024-04-26T21:37:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.625+0000 7f1013400640 1 -- 172.21.15.5:0/1584259076 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100802adb0 con 0x7f1014150570 2024-04-26T21:37:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.625+0000 7f1013400640 1 -- 172.21.15.5:0/1584259076 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008032660 con 0x7f1014150570 2024-04-26T21:37:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 -- 172.21.15.5:0/1584259076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1014150570 msgr2=0x7f101406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 --2- 172.21.15.5:0/1584259076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1014150570 0x7f101406eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10080097a0 tx=0x7f100802a060 comp rx=0 tx=0).stop 2024-04-26T21:37:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 -- 172.21.15.5:0/1584259076 shutdown_connections 2024-04-26T21:37:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 --2- 172.21.15.5:0/1584259076 >> v2:172.21.15.112:3300/0 conn(0x7f10140b28e0 0x7f1014150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 --2- 172.21.15.5:0/1584259076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1014150570 0x7f101406eab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 -- 172.21.15.5:0/1584259076 >> 172.21.15.5:0/1584259076 conn(0x7f10140b7bb0 msgr2=0x7f10140b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:15.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 -- 172.21.15.5:0/1584259076 shutdown_connections 2024-04-26T21:37:15.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.626+0000 7f101b800640 1 -- 172.21.15.5:0/1584259076 wait complete. 2024-04-26T21:37:15.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.627+0000 7f101b800640 1 Processor -- start 2024-04-26T21:37:15.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.628+0000 7f101b800640 1 -- start start 2024-04-26T21:37:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.628+0000 7f101b800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10140b28e0 0x7f1014149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.628+0000 7f101b800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1014150570 0x7f1014072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.628+0000 7f101b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014150950 0x7f1014070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.628+0000 7f101b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f101406e350 con 0x7f1014150950 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.628+0000 7f101b800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f101406e1d0 con 0x7f1014150570 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.628+0000 7f101b800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f10140afce0 con 0x7f10140b28e0 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014150950 0x7f1014070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014150950 0x7f1014070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40740/0 (socket says 172.21.15.5:40740) 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 -- 172.21.15.5:0/2110785574 learned_addr learned my addr 172.21.15.5:0/2110785574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1013e00640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1014150570 0x7f1014072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1018e00640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10140b28e0 0x7f1014149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 -- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10140b28e0 msgr2=0x7f1014149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10140b28e0 0x7f1014149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 -- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1014150570 msgr2=0x7f1014072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1014150570 0x7f1014072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.629+0000 7f1019800640 1 -- 172.21.15.5:0/2110785574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1014072800 con 0x7f1014150950 2024-04-26T21:37:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.630+0000 7f1019800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014150950 0x7f1014070aa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f100c00efc0 tx=0x7f100c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.630+0000 7f1010c00640 1 -- 172.21.15.5:0/2110785574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c018020 con 0x7f1014150950 2024-04-26T21:37:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.630+0000 7f1010c00640 1 -- 172.21.15.5:0/2110785574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c014480 con 0x7f1014150950 2024-04-26T21:37:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.630+0000 7f1010c00640 1 -- 172.21.15.5:0/2110785574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c014870 con 0x7f1014150950 2024-04-26T21:37:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.630+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10141e20e0 con 0x7f1014150950 2024-04-26T21:37:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.630+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1014148440 con 0x7f1014150950 2024-04-26T21:37:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.631+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1014070610 con 0x7f1014150950 2024-04-26T21:37:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.632+0000 7f1010c00640 1 -- 172.21.15.5:0/2110785574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f100c005d10 con 0x7f1014150950 2024-04-26T21:37:15.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.633+0000 7f1010c00640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ff406c940 0x7f0ff406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:15.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.634+0000 7f1010c00640 1 -- 172.21.15.5:0/2110785574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f100c08c410 con 0x7f1014150950 2024-04-26T21:37:15.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.634+0000 7f1018e00640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ff406c940 0x7f0ff406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:15.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.635+0000 7f1018e00640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ff406c940 0x7f0ff406ee00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1008034000 tx=0x7f100802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.639+0000 7f1010c00640 1 -- 172.21.15.5:0/2110785574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f100c022070 con 0x7f1014150950 2024-04-26T21:37:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:15.844+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f1014075db0 con 0x7f1014150950 2024-04-26T21:37:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.398+0000 7f1010c00640 1 -- 172.21.15.5:0/2110785574 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f1014072800 con 0x7f1014150950 2024-04-26T21:37:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-26T21:37:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ff406c940 msgr2=0x7f0ff406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ff406c940 0x7f0ff406ee00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1008034000 tx=0x7f100802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014150950 msgr2=0x7f1014070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014150950 0x7f1014070aa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f100c00efc0 tx=0x7f100c00c490 comp rx=0 tx=0).stop 2024-04-26T21:37:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 shutdown_connections 2024-04-26T21:37:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ff406c940 0x7f0ff406ee00 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1008034000 tx=0x7f100802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1014150950 0x7f1014070aa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1014150570 0x7f1014072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 --2- 172.21.15.5:0/2110785574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f10140b28e0 0x7f1014149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.403+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 >> 172.21.15.5:0/2110785574 conn(0x7f10140b7bb0 msgr2=0x7f101414f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.406+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 shutdown_connections 2024-04-26T21:37:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.406+0000 7f101b800640 1 -- 172.21.15.5:0/2110785574 wait complete. 2024-04-26T21:37:16.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T21:37:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.622+0000 7f4306400640 1 Processor -- start 2024-04-26T21:37:16.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.622+0000 7f4306400640 1 -- start start 2024-04-26T21:37:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.623+0000 7f4306400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43000b7b00 0x7f4300154230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.623+0000 7f4306400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43000bede0 con 0x7f430014cb70 2024-04-26T21:37:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.623+0000 7f4306400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43000b8050 con 0x7f43000bea00 2024-04-26T21:37:16.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.623+0000 7f4306400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4300143150 con 0x7f43000b7b00 2024-04-26T21:37:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.624+0000 7f42ffe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43000b7b00 0x7f4300154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.624+0000 7f42fea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f430014cb70 0x7f43000b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55754/0 (socket says 172.21.15.5:55754) 2024-04-26T21:37:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.624+0000 7f42fea00640 1 -- 172.21.15.5:0/3912144163 learned_addr learned my addr 172.21.15.5:0/3912144163 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.624+0000 7f42ffe00640 1 -- 172.21.15.5:0/3912144163 >> v1:172.21.15.112:6789/0 conn(0x7f43000bea00 legacy=0x7f4300148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.624+0000 7f42ffe00640 1 -- 172.21.15.5:0/3912144163 >> v1:172.21.15.5:6789/0 conn(0x7f430014cb70 legacy=0x7f43000b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.624+0000 7f42ffe00640 1 -- 172.21.15.5:0/3912144163 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430014c090 con 0x7f43000b7b00 2024-04-26T21:37:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.624+0000 7f42fe000640 1 -- 172.21.15.5:0/3912144163 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097678966 0 0) 0x7f43000bede0 con 0x7f430014cb70 2024-04-26T21:37:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.625+0000 7f42ffe00640 1 --2- 172.21.15.5:0/3912144163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000b7b00 0x7f4300154230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009d90 tx=0x7f42f802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff4b15c5381000a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f42fe000640 1 -- 172.21.15.5:0/3912144163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8007740 con 0x7f43000b7b00 2024-04-26T21:37:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f42fe000640 1 -- 172.21.15.5:0/3912144163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f80078e0 con 0x7f43000b7b00 2024-04-26T21:37:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f42fe000640 1 -- 172.21.15.5:0/3912144163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8007cb0 con 0x7f43000b7b00 2024-04-26T21:37:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f4306400640 1 -- 172.21.15.5:0/3912144163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000b7b00 msgr2=0x7f4300154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f4306400640 1 --2- 172.21.15.5:0/3912144163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000b7b00 0x7f4300154230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009d90 tx=0x7f42f802a660 comp rx=0 tx=0).stop 2024-04-26T21:37:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f4306400640 1 -- 172.21.15.5:0/3912144163 shutdown_connections 2024-04-26T21:37:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f4306400640 1 --2- 172.21.15.5:0/3912144163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000b7b00 0x7f4300154230 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f4306400640 1 -- 172.21.15.5:0/3912144163 >> 172.21.15.5:0/3912144163 conn(0x7f4300068720 msgr2=0x7f43000be080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f4306400640 1 -- 172.21.15.5:0/3912144163 shutdown_connections 2024-04-26T21:37:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.626+0000 7f4306400640 1 -- 172.21.15.5:0/3912144163 wait complete. 2024-04-26T21:37:16.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.628+0000 7f4306400640 1 Processor -- start 2024-04-26T21:37:16.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.628+0000 7f4306400640 1 -- start start 2024-04-26T21:37:16.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f4306400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000b7b00 0x7f4300145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:16.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f4306400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000bea00 0x7f4300145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:16.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f4306400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f430014cb70 0x7f43000b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f4306400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43000b44b0 con 0x7f43000bea00 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f4306400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f430014c650 con 0x7f43000b7b00 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f4306400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f43000b4630 con 0x7f430014cb70 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f42fea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000bea00 0x7f4300145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f42fea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000bea00 0x7f4300145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40748/0 (socket says 172.21.15.5:40748) 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.629+0000 7f42fea00640 1 -- 172.21.15.5:0/1433119846 learned_addr learned my addr 172.21.15.5:0/1433119846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42ffe00640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f430014cb70 0x7f43000b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42ff400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000b7b00 0x7f4300145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42fea00640 1 -- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f430014cb70 msgr2=0x7f43000b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42fea00640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f430014cb70 0x7f43000b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42fea00640 1 -- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000b7b00 msgr2=0x7f4300145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42fea00640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000b7b00 0x7f4300145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42fea00640 1 -- 172.21.15.5:0/1433119846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43001e1b70 con 0x7f43000bea00 2024-04-26T21:37:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42ff400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000b7b00 0x7f4300145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42fea00640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000bea00 0x7f4300145db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c3f0 tx=0x7f42ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42f7400640 1 -- 172.21.15.5:0/1433119846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0074e0 con 0x7f43000bea00 2024-04-26T21:37:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42f7400640 1 -- 172.21.15.5:0/1433119846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ec0047e0 con 0x7f43000bea00 2024-04-26T21:37:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f42f7400640 1 -- 172.21.15.5:0/1433119846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004c10 con 0x7f43000bea00 2024-04-26T21:37:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43001462f0 con 0x7f43000bea00 2024-04-26T21:37:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.630+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43001e20f0 con 0x7f43000bea00 2024-04-26T21:37:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.631+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4300075db0 con 0x7f43000bea00 2024-04-26T21:37:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.633+0000 7f42f7400640 1 -- 172.21.15.5:0/1433119846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42ec011070 con 0x7f43000bea00 2024-04-26T21:37:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.634+0000 7f42f7400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42e006c920 0x7f42e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.634+0000 7f42f7400640 1 -- 172.21.15.5:0/1433119846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f42ec08b6e0 con 0x7f43000bea00 2024-04-26T21:37:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.634+0000 7f42ff400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42e006c920 0x7f42e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:16.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.635+0000 7f42ff400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42e006c920 0x7f42e006ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000f60 tx=0x7f42f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:16.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.639+0000 7f42f7400640 1 -- 172.21.15.5:0/1433119846 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f42ec01a2b0 con 0x7f43000bea00 2024-04-26T21:37:16.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:16.884+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f43001e19a0 con 0x7f43000bea00 2024-04-26T21:37:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.402+0000 7f42f7400640 1 -- 172.21.15.5:0/1433119846 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f42ec059b60 con 0x7f43000bea00 2024-04-26T21:37:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T21:37:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42e006c920 msgr2=0x7f42e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42e006c920 0x7f42e006ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000f60 tx=0x7f42f0009040 comp rx=0 tx=0).stop 2024-04-26T21:37:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000bea00 msgr2=0x7f4300145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000bea00 0x7f4300145db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c3f0 tx=0x7f42ec00c8b0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 shutdown_connections 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f430014cb70 0x7f43000b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42e006c920 0x7f42e006ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43000bea00 0x7f4300145db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 --2- 172.21.15.5:0/1433119846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43000b7b00 0x7f4300145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.406+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 >> 172.21.15.5:0/1433119846 conn(0x7f4300068720 msgr2=0x7f43000b8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.407+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 shutdown_connections 2024-04-26T21:37:17.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.407+0000 7f4306400640 1 -- 172.21.15.5:0/1433119846 wait complete. 2024-04-26T21:37:17.457 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T21:37:17.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T21:37:17.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.634+0000 7fcb00a00640 1 Processor -- start 2024-04-26T21:37:17.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.635+0000 7fcb00a00640 1 -- start start 2024-04-26T21:37:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcb00a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcafc0be640 0x7fcafc0b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcb00a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcafc0b5ca0 0x7fcafc142930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcb00a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcafc0b7b80 con 0x7fcafc0b4250 2024-04-26T21:37:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcb00a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcafc0bea20 con 0x7fcafc0be640 2024-04-26T21:37:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcb00a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcafc0b6680 con 0x7fcafc0b5ca0 2024-04-26T21:37:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcafa800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcafc0be640 0x7fcafc0b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcafa800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcafc0be640 0x7fcafc0b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40762/0 (socket says 172.21.15.5:40762) 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.636+0000 7fcafa800640 1 -- 172.21.15.5:0/2194660973 learned_addr learned my addr 172.21.15.5:0/2194660973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.637+0000 7fcafa800640 1 -- 172.21.15.5:0/2194660973 >> v2:172.21.15.112:3300/0 conn(0x7fcafc0b5ca0 msgr2=0x7fcafc142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.637+0000 7fcafb200640 1 --2- 172.21.15.5:0/2194660973 >> v2:172.21.15.112:3300/0 conn(0x7fcafc0b5ca0 0x7fcafc142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.637+0000 7fcafa800640 1 --2- 172.21.15.5:0/2194660973 >> v2:172.21.15.112:3300/0 conn(0x7fcafc0b5ca0 0x7fcafc142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.637+0000 7fcafa800640 1 -- 172.21.15.5:0/2194660973 >> v1:172.21.15.112:6789/0 conn(0x7fcafc0b4250 legacy=0x7fcafc142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.637+0000 7fcafa800640 1 -- 172.21.15.5:0/2194660973 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc0b6960 con 0x7fcafc0be640 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.637+0000 7fcafb200640 1 --2- 172.21.15.5:0/2194660973 >> v2:172.21.15.112:3300/0 conn(0x7fcafc0b5ca0 0x7fcafc142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.638+0000 7fcafa800640 1 --2- 172.21.15.5:0/2194660973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc0b5760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0b74e0 tx=0x7fcaec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88e9865d1381094 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.638+0000 7fcaf9400640 1 -- 172.21.15.5:0/2194660973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec037070 con 0x7fcafc0be640 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.638+0000 7fcaf9400640 1 -- 172.21.15.5:0/2194660973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaec032440 con 0x7fcafc0be640 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.638+0000 7fcaf9400640 1 -- 172.21.15.5:0/2194660973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec032810 con 0x7fcafc0be640 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 -- 172.21.15.5:0/2194660973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 msgr2=0x7fcafc0b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2194660973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc0b5760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0b74e0 tx=0x7fcaec02a1a0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 -- 172.21.15.5:0/2194660973 shutdown_connections 2024-04-26T21:37:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2194660973 >> v2:172.21.15.112:3300/0 conn(0x7fcafc0b5ca0 0x7fcafc142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2194660973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc0b5760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 -- 172.21.15.5:0/2194660973 >> 172.21.15.5:0/2194660973 conn(0x7fcafc0686c0 msgr2=0x7fcafc0bdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 -- 172.21.15.5:0/2194660973 shutdown_connections 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.639+0000 7fcb00a00640 1 -- 172.21.15.5:0/2194660973 wait complete. 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.640+0000 7fcb00a00640 1 Processor -- start 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.641+0000 7fcb00a00640 1 -- start start 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.641+0000 7fcb00a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcafc0b4250 0x7fcafc0bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.641+0000 7fcb00a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcafc0b5ca0 0x7fcafc1e1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.641+0000 7fcb00a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc1e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.641+0000 7fcb00a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0ba430 con 0x7fcafc0be640 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.641+0000 7fcb00a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0b4cf0 con 0x7fcafc0b5ca0 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.641+0000 7fcb00a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc137f10 con 0x7fcafc0b4250 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc1e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc1e1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40768/0 (socket says 172.21.15.5:40768) 2024-04-26T21:37:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 -- 172.21.15.5:0/2316916220 learned_addr learned my addr 172.21.15.5:0/2316916220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 -- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcafc0b4250 msgr2=0x7fcafc0bcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcafc0b4250 0x7fcafc0bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 -- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcafc0b5ca0 msgr2=0x7fcafc1e1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcafc0b5ca0 0x7fcafc1e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 -- 172.21.15.5:0/2316916220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc138440 con 0x7fcafc0be640 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.642+0000 7fcafb200640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc1e1ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400c5e0 tx=0x7fcaf400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.643+0000 7fcaf2a00640 1 -- 172.21.15.5:0/2316916220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4015070 con 0x7fcafc0be640 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.643+0000 7fcaf2a00640 1 -- 172.21.15.5:0/2316916220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf4011840 con 0x7fcafc0be640 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.643+0000 7fcaf2a00640 1 -- 172.21.15.5:0/2316916220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011c30 con 0x7fcafc0be640 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.643+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc136fa0 con 0x7fcafc0be640 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.643+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc138160 con 0x7fcafc0be640 2024-04-26T21:37:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.644+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc0b9490 con 0x7fcafc0be640 2024-04-26T21:37:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.645+0000 7fcaf2a00640 1 -- 172.21.15.5:0/2316916220 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcaf4018070 con 0x7fcafc0be640 2024-04-26T21:37:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.647+0000 7fcaf2a00640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcad806c8f0 0x7fcad806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.647+0000 7fcaf2a00640 1 -- 172.21.15.5:0/2316916220 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fcaf408ba10 con 0x7fcafc0be640 2024-04-26T21:37:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.647+0000 7fcafa800640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcad806c8f0 0x7fcad806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.648+0000 7fcafa800640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcad806c8f0 0x7fcad806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaec034000 tx=0x7fcaec02c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.652+0000 7fcaf2a00640 1 -- 172.21.15.5:0/2316916220 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcafc0b9490 con 0x7fcafc0be640 2024-04-26T21:37:17.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:17.863+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fcafc075db0 con 0x7fcafc0be640 2024-04-26T21:37:18.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.432+0000 7fcaf2a00640 1 -- 172.21.15.5:0/2316916220 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fcaf4059e30 con 0x7fcafc0be640 2024-04-26T21:37:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.436+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcad806c8f0 msgr2=0x7fcad806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.436+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcad806c8f0 0x7fcad806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaec034000 tx=0x7fcaec02c000 comp rx=0 tx=0).stop 2024-04-26T21:37:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.436+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 msgr2=0x7fcafc1e1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:18.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.436+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc1e1ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400c5e0 tx=0x7fcaf400caa0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.437+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 shutdown_connections 2024-04-26T21:37:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.437+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcad806c8f0 0x7fcad806edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.437+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcafc0be640 0x7fcafc1e1ed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.437+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcafc0b5ca0 0x7fcafc1e1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.437+0000 7fcb00a00640 1 --2- 172.21.15.5:0/2316916220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcafc0b4250 0x7fcafc0bcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.437+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 >> 172.21.15.5:0/2316916220 conn(0x7fcafc0686c0 msgr2=0x7fcafc148620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.438+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 shutdown_connections 2024-04-26T21:37:18.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.439+0000 7fcb00a00640 1 -- 172.21.15.5:0/2316916220 wait complete. 2024-04-26T21:37:18.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T21:37:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.676+0000 7fe6b0c00640 1 Processor -- start 2024-04-26T21:37:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.676+0000 7fe6b0c00640 1 -- start start 2024-04-26T21:37:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.678+0000 7fe6b0c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 0x7fe6ac0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.678+0000 7fe6b0c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac0bb280 con 0x7fe6ac141fa0 2024-04-26T21:37:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.678+0000 7fe6b0c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac0b5370 con 0x7fe6ac0ba2c0 2024-04-26T21:37:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.678+0000 7fe6b0c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b7cf0 con 0x7fe6ac0baea0 2024-04-26T21:37:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.678+0000 7fe6abe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe6ac141fa0 0x7fe6ac152d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55756/0 (socket says 172.21.15.5:55756) 2024-04-26T21:37:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.678+0000 7fe6abe00640 1 -- 172.21.15.5:0/382529593 learned_addr learned my addr 172.21.15.5:0/382529593 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6ab400640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 0x7fe6ac0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572090057 0 0) 0x7fe6ac0bb280 con 0x7fe6ac141fa0 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe690003520 con 0x7fe6ac141fa0 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4216981205 0 0) 0x7fe690003520 con 0x7fe6ac141fa0 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 msgr2=0x7fe6ac0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 0x7fe6ac0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 >> v1:172.21.15.112:6789/0 conn(0x7fe6ac0ba2c0 legacy=0x7fe6ac14b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac0b5650 con 0x7fe6ac141fa0 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fe6a40019f0 con 0x7fe6ac141fa0 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 >> v1:172.21.15.5:6789/0 conn(0x7fe6ac141fa0 legacy=0x7fe6ac152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 0x7fe6900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe690003f60 0x7fe690004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe690004d40 0x7fe6900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b7cf0 con 0x7fe690004d40 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe69000bc00 con 0x7fe690003f60 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.679+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe69000be00 con 0x7fe6ac0baea0 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6abe00640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe690004d40 0x7fe6900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6ab400640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 0x7fe6900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6aaa00640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe690003f60 0x7fe690004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6abe00640 1 -- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 msgr2=0x7fe6900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6abe00640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac0baea0 0x7fe6900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6abe00640 1 -- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe690003f60 msgr2=0x7fe690004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6abe00640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe690003f60 0x7fe690004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6abe00640 1 -- 172.21.15.5:0/382529593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe690003520 con 0x7fe690004d40 2024-04-26T21:37:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.680+0000 7fe6aaa00640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe690003f60 0x7fe690004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.681+0000 7fe6abe00640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe690004d40 0x7fe6900051c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400a860 tx=0x7fe690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d92aa0139645955 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.681+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400a480 con 0x7fe690004d40 2024-04-26T21:37:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.681+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a402f070 con 0x7fe690004d40 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.681+0000 7fe6aa000640 1 -- 172.21.15.5:0/382529593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a402bd40 con 0x7fe690004d40 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.682+0000 7fe6b0c00640 1 -- 172.21.15.5:0/382529593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe690004d40 msgr2=0x7fe6900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.682+0000 7fe6b0c00640 1 --2- 172.21.15.5:0/382529593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe690004d40 0x7fe6900051c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400a860 tx=0x7fe690005830 comp rx=0 tx=0).stop 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.682+0000 7fe6abe00640 1 -- 172.21.15.5:0/382529593 reap_dead start 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.682+0000 7fe6b0c00640 1 -- 172.21.15.5:0/382529593 shutdown_connections 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.682+0000 7fe6b0c00640 1 -- 172.21.15.5:0/382529593 >> 172.21.15.5:0/382529593 conn(0x7fe6ac0684b0 msgr2=0x7fe6ac0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.682+0000 7fe6b0c00640 1 -- 172.21.15.5:0/382529593 shutdown_connections 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.682+0000 7fe6b0c00640 1 -- 172.21.15.5:0/382529593 wait complete. 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.684+0000 7fe6b0c00640 1 Processor -- start 2024-04-26T21:37:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.684+0000 7fe6b0c00640 1 -- start start 2024-04-26T21:37:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6b0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac13d430 0x7fe6ac13d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6b0c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac13c470 0x7fe6ac1ddf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6b0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac1de490 0x7fe6ac1e1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6b0c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b6820 con 0x7fe6ac13d430 2024-04-26T21:37:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6b0c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac14c0d0 con 0x7fe6ac1de490 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6b0c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac0b69a0 con 0x7fe6ac13c470 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac13d430 0x7fe6ac13d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac13d430 0x7fe6ac13d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40778/0 (socket says 172.21.15.5:40778) 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 -- 172.21.15.5:0/1218593959 learned_addr learned my addr 172.21.15.5:0/1218593959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6aaa00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac13c470 0x7fe6ac1ddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6abe00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac1de490 0x7fe6ac1e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 -- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac13c470 msgr2=0x7fe6ac1ddf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac13c470 0x7fe6ac1ddf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 -- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac1de490 msgr2=0x7fe6ac1e1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac1de490 0x7fe6ac1e1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6ab400640 1 -- 172.21.15.5:0/1218593959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac1de8f0 con 0x7fe6ac13d430 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.685+0000 7fe6abe00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac1de490 0x7fe6ac1e1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.686+0000 7fe6ab400640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac13d430 0x7fe6ac13d810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe69c011600 tx=0x7fe69c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.686+0000 7fe6a3400640 1 -- 172.21.15.5:0/1218593959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00f920 con 0x7fe6ac13d430 2024-04-26T21:37:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.686+0000 7fe6a3400640 1 -- 172.21.15.5:0/1218593959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69c00fac0 con 0x7fe6ac13d430 2024-04-26T21:37:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.686+0000 7fe6a3400640 1 -- 172.21.15.5:0/1218593959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00fe70 con 0x7fe6ac13d430 2024-04-26T21:37:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.686+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac0b4760 con 0x7fe6ac13d430 2024-04-26T21:37:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.686+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac1d33e0 con 0x7fe6ac13d430 2024-04-26T21:37:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.687+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ac075db0 con 0x7fe6ac13d430 2024-04-26T21:37:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.688+0000 7fe6a3400640 1 -- 172.21.15.5:0/1218593959 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe69c015460 con 0x7fe6ac13d430 2024-04-26T21:37:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.689+0000 7fe6a3400640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe68c06c8f0 0x7fe68c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.689+0000 7fe6a3400640 1 -- 172.21.15.5:0/1218593959 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fe69c08c270 con 0x7fe6ac13d430 2024-04-26T21:37:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.690+0000 7fe6aaa00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe68c06c8f0 0x7fe68c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.691+0000 7fe6aaa00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe68c06c8f0 0x7fe68c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0bd5e0 tx=0x7fe698009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:18.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.693+0000 7fe6a3400640 1 -- 172.21.15.5:0/1218593959 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe69c019030 con 0x7fe6ac13d430 2024-04-26T21:37:18.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:18.899+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe6ac0b7a10 con 0x7fe6ac13d430 2024-04-26T21:37:20.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.448+0000 7fe6a3400640 1 -- 172.21.15.5:0/1218593959 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fe69c05a560 con 0x7fe6ac13d430 2024-04-26T21:37:20.450 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' created 2024-04-26T21:37:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.454+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe68c06c8f0 msgr2=0x7fe68c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.454+0000 7fe6b0c00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe68c06c8f0 0x7fe68c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0bd5e0 tx=0x7fe698009040 comp rx=0 tx=0).stop 2024-04-26T21:37:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.454+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac13d430 msgr2=0x7fe6ac13d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:20.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.454+0000 7fe6b0c00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac13d430 0x7fe6ac13d810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe69c011600 tx=0x7fe69c011ac0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.454+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 shutdown_connections 2024-04-26T21:37:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.455+0000 7fe6b0c00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6ac1de490 0x7fe6ac1e1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.455+0000 7fe6b0c00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6ac13c470 0x7fe6ac1ddf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.455+0000 7fe6b0c00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe68c06c8f0 0x7fe68c06edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.455+0000 7fe6b0c00640 1 --2- 172.21.15.5:0/1218593959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6ac13d430 0x7fe6ac13d810 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe69c011600 tx=0x7fe69c011ac0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.455+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 >> 172.21.15.5:0/1218593959 conn(0x7fe6ac0684b0 msgr2=0x7fe6ac0be630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.456+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 shutdown_connections 2024-04-26T21:37:20.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.456+0000 7fe6b0c00640 1 -- 172.21.15.5:0/1218593959 wait complete. 2024-04-26T21:37:20.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T21:37:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.674+0000 7ff1afe00640 1 Processor -- start 2024-04-26T21:37:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.675+0000 7ff1afe00640 1 -- start start 2024-04-26T21:37:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.676+0000 7ff1afe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff1b00be740 0x7ff1b014bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.676+0000 7ff1afe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b00b7f10 con 0x7ff1b00b6c60 2024-04-26T21:37:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.676+0000 7ff1afe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b00beb20 con 0x7ff1b01428e0 2024-04-26T21:37:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.676+0000 7ff1afe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b00b5e90 con 0x7ff1b00be740 2024-04-26T21:37:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.676+0000 7ff1ae000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff1b00b6c60 0x7ff1b01421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55770/0 (socket says 172.21.15.5:55770) 2024-04-26T21:37:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.676+0000 7ff1ae000640 1 -- 172.21.15.5:0/972893810 learned_addr learned my addr 172.21.15.5:0/972893810 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1aea00640 1 --2- 172.21.15.5:0/972893810 >> v2:172.21.15.112:3300/0 conn(0x7ff1b00be740 0x7ff1b014bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497870730 0 0) 0x7ff1b00b7f10 con 0x7ff1b00b6c60 2024-04-26T21:37:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff194003520 con 0x7ff1b00b6c60 2024-04-26T21:37:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2142574256 0 0) 0x7ff194003520 con 0x7ff1b00b6c60 2024-04-26T21:37:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 >> v2:172.21.15.112:3300/0 conn(0x7ff1b00be740 msgr2=0x7ff1b014bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 --2- 172.21.15.5:0/972893810 >> v2:172.21.15.112:3300/0 conn(0x7ff1b00be740 0x7ff1b014bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 >> v1:172.21.15.112:6789/0 conn(0x7ff1b01428e0 legacy=0x7ff1b0152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b00b5840 con 0x7ff1b00b6c60 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7ff198001670 con 0x7ff1b00b6c60 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 >> v1:172.21.15.5:6789/0 conn(0x7ff1b00b6c60 legacy=0x7ff1b01421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff194003a00 0x7ff194003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff194004800 0x7ff194004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1940052e0 0x7ff19400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b5e90 con 0x7ff194004800 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff19400c1e0 con 0x7ff194003a00 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.677+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff19400c3e0 con 0x7ff1940052e0 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1ae000640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff194004800 0x7ff194004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1aea00640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff194003a00 0x7ff194003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1ae000640 1 -- 172.21.15.5:0/972893810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1940052e0 msgr2=0x7ff19400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1ae000640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1940052e0 0x7ff19400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1ae000640 1 -- 172.21.15.5:0/972893810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff194003a00 msgr2=0x7ff194003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1ae000640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff194003a00 0x7ff194003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1ae000640 1 -- 172.21.15.5:0/972893810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff194003520 con 0x7ff194004800 2024-04-26T21:37:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.678+0000 7ff1af400640 1 -- 172.21.15.5:0/972893810 reap_dead start 2024-04-26T21:37:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.679+0000 7ff1ae000640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff194004800 0x7ff194004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c110 tx=0x7ff194005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719d770b6b71089c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.679+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198007c40 con 0x7ff194004800 2024-04-26T21:37:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.679+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff198005af0 con 0x7ff194004800 2024-04-26T21:37:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.679+0000 7ff1ad600640 1 -- 172.21.15.5:0/972893810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198007070 con 0x7ff194004800 2024-04-26T21:37:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.680+0000 7ff1afe00640 1 -- 172.21.15.5:0/972893810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff194004800 msgr2=0x7ff194004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.680+0000 7ff1afe00640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff194004800 0x7ff194004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c110 tx=0x7ff194005830 comp rx=0 tx=0).stop 2024-04-26T21:37:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.680+0000 7ff1afe00640 1 -- 172.21.15.5:0/972893810 shutdown_connections 2024-04-26T21:37:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.680+0000 7ff1afe00640 1 --2- 172.21.15.5:0/972893810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff194004800 0x7ff194004c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.680+0000 7ff1afe00640 1 -- 172.21.15.5:0/972893810 >> 172.21.15.5:0/972893810 conn(0x7ff1b00686c0 msgr2=0x7ff1b00bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.680+0000 7ff1afe00640 1 -- 172.21.15.5:0/972893810 shutdown_connections 2024-04-26T21:37:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.680+0000 7ff1afe00640 1 -- 172.21.15.5:0/972893810 wait complete. 2024-04-26T21:37:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.682+0000 7ff1afe00640 1 Processor -- start 2024-04-26T21:37:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.682+0000 7ff1afe00640 1 -- start start 2024-04-26T21:37:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1afe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff194004800 0x7ff1b0145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b00aa630 0x7ff1b01e1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1afe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1b01e1db0 0x7ff1b01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1afe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b55e0 con 0x7ff1b00aa630 2024-04-26T21:37:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1afe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b5460 con 0x7ff1b01e1db0 2024-04-26T21:37:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1afe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b00ba480 con 0x7ff194004800 2024-04-26T21:37:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1ae000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b00aa630 0x7ff1b01e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1ae000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b00aa630 0x7ff1b01e1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40800/0 (socket says 172.21.15.5:40800) 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1ae000640 1 -- 172.21.15.5:0/2408247179 learned_addr learned my addr 172.21.15.5:0/2408247179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1af400640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1b01e1db0 0x7ff1b01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.683+0000 7ff1aea00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff194004800 0x7ff1b0145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1ae000640 1 -- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff194004800 msgr2=0x7ff1b0145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1ae000640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff194004800 0x7ff1b0145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1ae000640 1 -- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1b01e1db0 msgr2=0x7ff1b01400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1ae000640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1b01e1db0 0x7ff1b01400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1ae000640 1 -- 172.21.15.5:0/2408247179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b00aae40 con 0x7ff1b00aa630 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1ae000640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b00aa630 0x7ff1b01e1870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c230 tx=0x7ff1b00b5a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1a6a00640 1 -- 172.21.15.5:0/2408247179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198037040 con 0x7ff1b00aa630 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1a6a00640 1 -- 172.21.15.5:0/2408247179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff198041070 con 0x7ff1b00aa630 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1a6a00640 1 -- 172.21.15.5:0/2408247179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198004a00 con 0x7ff1b00aa630 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.684+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b01d5290 con 0x7ff1b00aa630 2024-04-26T21:37:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.685+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b01d2b70 con 0x7ff1b00aa630 2024-04-26T21:37:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.686+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b00b8410 con 0x7ff1b00aa630 2024-04-26T21:37:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.687+0000 7ff1a6a00640 1 -- 172.21.15.5:0/2408247179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff198004ba0 con 0x7ff1b00aa630 2024-04-26T21:37:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.688+0000 7ff1a6a00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff18c06c8f0 0x7ff18c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.688+0000 7ff1a6a00640 1 -- 172.21.15.5:0/2408247179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7ff1980abc80 con 0x7ff1b00aa630 2024-04-26T21:37:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.688+0000 7ff1aea00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff18c06c8f0 0x7ff18c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.690+0000 7ff1aea00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff18c06c8f0 0x7ff18c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0077620 tx=0x7ff1a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.693+0000 7ff1a6a00640 1 -- 172.21.15.5:0/2408247179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff1b00b8410 con 0x7ff1b00aa630 2024-04-26T21:37:20.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:20.895+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff1b0141c50 con 0x7ff1b00aa630 2024-04-26T21:37:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.453+0000 7ff1a6a00640 1 -- 172.21.15.5:0/2408247179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7ff1b0141c50 con 0x7ff1b00aa630 2024-04-26T21:37:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T21:37:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff18c06c8f0 msgr2=0x7ff18c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff18c06c8f0 0x7ff18c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0077620 tx=0x7ff1a0008040 comp rx=0 tx=0).stop 2024-04-26T21:37:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b00aa630 msgr2=0x7ff1b01e1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b00aa630 0x7ff1b01e1870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c230 tx=0x7ff1b00b5a10 comp rx=0 tx=0).stop 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 shutdown_connections 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1b01e1db0 0x7ff1b01400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff18c06c8f0 0x7ff18c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b00aa630 0x7ff1b01e1870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.456+0000 7ff1afe00640 1 --2- 172.21.15.5:0/2408247179 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff194004800 0x7ff1b0145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.457+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 >> 172.21.15.5:0/2408247179 conn(0x7ff1b00686c0 msgr2=0x7ff1b00bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.457+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 shutdown_connections 2024-04-26T21:37:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.457+0000 7ff1afe00640 1 -- 172.21.15.5:0/2408247179 wait complete. 2024-04-26T21:37:21.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T21:37:21.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.681+0000 7f073e000640 1 Processor -- start 2024-04-26T21:37:21.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.681+0000 7f073e000640 1 -- start start 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.681+0000 7f073e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f073814fd80 0x7f0738152170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.681+0000 7f073e000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07380b3bb0 con 0x7f073806e780 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.681+0000 7f073e000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073806eb60 con 0x7f07381401f0 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.681+0000 7f073e000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f07380b3440 con 0x7f073814fd80 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0737e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f073814fd80 0x7f0738152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0737e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f073814fd80 0x7f0738152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40806/0 (socket says 172.21.15.5:40806) 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0737400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f073806e780 0x7f07380b1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55780/0 (socket says 172.21.15.5:55780) 2024-04-26T21:37:21.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0737e00640 1 -- 172.21.15.5:0/3977320217 learned_addr learned my addr 172.21.15.5:0/3977320217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:21.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0737e00640 1 -- 172.21.15.5:0/3977320217 >> v1:172.21.15.112:6789/0 conn(0x7f07381401f0 legacy=0x7f0738140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:21.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0737e00640 1 -- 172.21.15.5:0/3977320217 >> v1:172.21.15.5:6789/0 conn(0x7f073806e780 legacy=0x7f07380b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:21.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0737e00640 1 -- 172.21.15.5:0/3977320217 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07380b11b0 con 0x7f073814fd80 2024-04-26T21:37:21.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.682+0000 7f0736a00640 1 -- 172.21.15.5:0/3977320217 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616660276 0 0) 0x7f07380b3bb0 con 0x7f073806e780 2024-04-26T21:37:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.683+0000 7f0737e00640 1 --2- 172.21.15.5:0/3977320217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073814fd80 0x7f0738152170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0730009e50 tx=0x7f073002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3552687a992192 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f0736a00640 1 -- 172.21.15.5:0/3977320217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730036070 con 0x7f073814fd80 2024-04-26T21:37:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f0736a00640 1 -- 172.21.15.5:0/3977320217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0730031600 con 0x7f073814fd80 2024-04-26T21:37:21.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f0736a00640 1 -- 172.21.15.5:0/3977320217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07300319d0 con 0x7f073814fd80 2024-04-26T21:37:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f073e000640 1 -- 172.21.15.5:0/3977320217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073814fd80 msgr2=0x7f0738152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f073e000640 1 --2- 172.21.15.5:0/3977320217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073814fd80 0x7f0738152170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0730009e50 tx=0x7f073002a6d0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f073e000640 1 -- 172.21.15.5:0/3977320217 shutdown_connections 2024-04-26T21:37:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f073e000640 1 --2- 172.21.15.5:0/3977320217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f073814fd80 0x7f0738152170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f073e000640 1 -- 172.21.15.5:0/3977320217 >> 172.21.15.5:0/3977320217 conn(0x7f07380b7bb0 msgr2=0x7f07380b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.684+0000 7f073e000640 1 -- 172.21.15.5:0/3977320217 shutdown_connections 2024-04-26T21:37:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.685+0000 7f073e000640 1 -- 172.21.15.5:0/3977320217 wait complete. 2024-04-26T21:37:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.686+0000 7f073e000640 1 Processor -- start 2024-04-26T21:37:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.686+0000 7f073e000640 1 -- start start 2024-04-26T21:37:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f073e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f073806e780 0x7f0738073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f073e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381401f0 0x7f07380b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f073e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073814fd80 0x7f073806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f073e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07380b4090 con 0x7f07381401f0 2024-04-26T21:37:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f073e000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f07380b30c0 con 0x7f073814fd80 2024-04-26T21:37:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f073e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f073813c0d0 con 0x7f073806e780 2024-04-26T21:37:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f072fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381401f0 0x7f07380b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f072fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381401f0 0x7f07380b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40810/0 (socket says 172.21.15.5:40810) 2024-04-26T21:37:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.687+0000 7f072fe00640 1 -- 172.21.15.5:0/975429588 learned_addr learned my addr 172.21.15.5:0/975429588 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f0737e00640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073814fd80 0x7f073806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f0737400640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f073806e780 0x7f0738073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072fe00640 1 -- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f073806e780 msgr2=0x7f0738073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072fe00640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f073806e780 0x7f0738073200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072fe00640 1 -- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073814fd80 msgr2=0x7f073806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:21.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072fe00640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073814fd80 0x7f073806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072fe00640 1 -- 172.21.15.5:0/975429588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0738073740 con 0x7f07381401f0 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072fe00640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381401f0 0x7f07380b5810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f072000c430 tx=0x7f072000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072f400640 1 -- 172.21.15.5:0/975429588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720011790 con 0x7f07381401f0 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.688+0000 7f072f400640 1 -- 172.21.15.5:0/975429588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0720017070 con 0x7f07381401f0 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.689+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073813c340 con 0x7f07381401f0 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.689+0000 7f072f400640 1 -- 172.21.15.5:0/975429588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720011b70 con 0x7f07381401f0 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.689+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073806de70 con 0x7f07381401f0 2024-04-26T21:37:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.690+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0738075db0 con 0x7f07381401f0 2024-04-26T21:37:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.691+0000 7f072f400640 1 -- 172.21.15.5:0/975429588 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0720011d10 con 0x7f07381401f0 2024-04-26T21:37:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.693+0000 7f072f400640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f071406c8f0 0x7f071406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.693+0000 7f072f400640 1 -- 172.21.15.5:0/975429588 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f072008bcf0 con 0x7f07381401f0 2024-04-26T21:37:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.693+0000 7f0737400640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f071406c8f0 0x7f071406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:21.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.694+0000 7f0737400640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f071406c8f0 0x7f071406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0728000f60 tx=0x7f0728007b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:21.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.698+0000 7f072f400640 1 -- 172.21.15.5:0/975429588 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0738073740 con 0x7f07381401f0 2024-04-26T21:37:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:21.939+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f07380b9a90 con 0x7f07381401f0 2024-04-26T21:37:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.508+0000 7f072f400640 1 -- 172.21.15.5:0/975429588 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f0720059df0 con 0x7f07381401f0 2024-04-26T21:37:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:added data pool 4 to fsmap 2024-04-26T21:37:22.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.511+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f071406c8f0 msgr2=0x7f071406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:22.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.511+0000 7f073e000640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f071406c8f0 0x7f071406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0728000f60 tx=0x7f0728007b50 comp rx=0 tx=0).stop 2024-04-26T21:37:22.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.511+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381401f0 msgr2=0x7f07380b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:22.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.511+0000 7f073e000640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381401f0 0x7f07380b5810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f072000c430 tx=0x7f072000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 shutdown_connections 2024-04-26T21:37:22.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f073814fd80 0x7f073806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f071406c8f0 0x7f071406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381401f0 0x7f07380b5810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 --2- 172.21.15.5:0/975429588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f073806e780 0x7f0738073200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 >> 172.21.15.5:0/975429588 conn(0x7f07380b7bb0 msgr2=0x7f07381445c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 shutdown_connections 2024-04-26T21:37:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.512+0000 7f073e000640 1 -- 172.21.15.5:0/975429588 wait complete. 2024-04-26T21:37:22.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:37:22.576 INFO:tasks.ceph.mds.b.smithi112.stderr:2024-04-26T21:37:22.576+0000 7fc6edc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:37:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.735+0000 7f42df200640 1 Processor -- start 2024-04-26T21:37:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.736+0000 7f42df200640 1 -- start start 2024-04-26T21:37:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.737+0000 7f42df200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d8073d20 0x7f42d8151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.737+0000 7f42df200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d8070bc0 con 0x7f42d80b5fc0 2024-04-26T21:37:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.737+0000 7f42df200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d80b3740 con 0x7f42d80b3360 2024-04-26T21:37:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.737+0000 7f42df200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42d80b43e0 con 0x7f42d8073d20 2024-04-26T21:37:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.737+0000 7f42dd400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42d80b5fc0 0x7f42d8073610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55796/0 (socket says 172.21.15.5:55796) 2024-04-26T21:37:22.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.737+0000 7f42dd400640 1 -- 172.21.15.5:0/647269659 learned_addr learned my addr 172.21.15.5:0/647269659 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42de800640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d8073d20 0x7f42d8151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732264470 0 0) 0x7f42d8070bc0 con 0x7f42d80b5fc0 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c0003520 con 0x7f42d80b5fc0 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1277489373 0 0) 0x7f42c0003520 con 0x7f42d80b5fc0 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d8073d20 msgr2=0x7f42d8151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d8073d20 0x7f42d8151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 >> v1:172.21.15.112:6789/0 conn(0x7f42d80b3360 legacy=0x7f42d8146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d80708e0 con 0x7f42d80b5fc0 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f42c8001690 con 0x7f42d80b5fc0 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 >> v1:172.21.15.5:6789/0 conn(0x7f42d80b5fc0 legacy=0x7f42d8073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00039e0 0x7f42c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c0005210 0x7f42c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42c000c090 con 0x7f42c0004800 2024-04-26T21:37:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42c000c240 con 0x7f42c00039e0 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42c000c440 con 0x7f42c0005210 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.738+0000 7f42de800640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d8073d20 0x7f42d8151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dd400640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42de800640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c0005210 0x7f42c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dde00640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00039e0 0x7f42c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dd400640 1 -- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c0005210 msgr2=0x7f42c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dd400640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c0005210 0x7f42c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dd400640 1 -- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00039e0 msgr2=0x7f42c0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dd400640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00039e0 0x7f42c0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dd400640 1 -- 172.21.15.5:0/647269659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c0003520 con 0x7f42c0004800 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42de800640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c0005210 0x7f42c000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.739+0000 7f42dde00640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c00039e0 0x7f42c0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.740+0000 7f42dd400640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42c0004c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42d8070d90 tx=0x7f42c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c84d2cc3644fa1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.740+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8007c60 con 0x7f42c0004800 2024-04-26T21:37:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.740+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c8005ad0 con 0x7f42c0004800 2024-04-26T21:37:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.740+0000 7f42dca00640 1 -- 172.21.15.5:0/647269659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8007070 con 0x7f42c0004800 2024-04-26T21:37:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.741+0000 7f42df200640 1 -- 172.21.15.5:0/647269659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 msgr2=0x7f42c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.741+0000 7f42df200640 1 --2- 172.21.15.5:0/647269659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42c0004c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42d8070d90 tx=0x7f42c0005830 comp rx=0 tx=0).stop 2024-04-26T21:37:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.741+0000 7f42de800640 1 -- 172.21.15.5:0/647269659 reap_dead start 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.741+0000 7f42df200640 1 -- 172.21.15.5:0/647269659 shutdown_connections 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.741+0000 7f42df200640 1 -- 172.21.15.5:0/647269659 >> 172.21.15.5:0/647269659 conn(0x7f42d806c300 msgr2=0x7f42d806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.741+0000 7f42df200640 1 -- 172.21.15.5:0/647269659 shutdown_connections 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.741+0000 7f42df200640 1 -- 172.21.15.5:0/647269659 wait complete. 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.743+0000 7f42df200640 1 Processor -- start 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.743+0000 7f42df200640 1 -- start start 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42df200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42d8142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42df200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42d8141340 0x7f42d813d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42df200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d81dca80 0x7f42d81dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42df200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42d806ebc0 con 0x7f42c0004800 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42df200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8071c20 con 0x7f42d8141340 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42df200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42d8147150 con 0x7f42d81dca80 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42d8142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42d8142790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40832/0 (socket says 172.21.15.5:40832) 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 -- 172.21.15.5:0/2629572562 learned_addr learned my addr 172.21.15.5:0/2629572562 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 -- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d81dca80 msgr2=0x7f42d81dcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42de800640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d81dca80 0x7f42d81dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d81dca80 0x7f42d81dcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 -- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42d8141340 msgr2=0x7f42d813d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42d8141340 0x7f42d813d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.744+0000 7f42dde00640 1 -- 172.21.15.5:0/2629572562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d81417c0 con 0x7f42c0004800 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.745+0000 7f42dde00640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42d8142790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00d7a0 tx=0x7f42cc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.745+0000 7f42d2000640 1 -- 172.21.15.5:0/2629572562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc005070 con 0x7f42c0004800 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.745+0000 7f42d2000640 1 -- 172.21.15.5:0/2629572562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc005210 con 0x7f42c0004800 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.745+0000 7f42d2000640 1 -- 172.21.15.5:0/2629572562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc007030 con 0x7f42c0004800 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.745+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d813d7c0 con 0x7f42c0004800 2024-04-26T21:37:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.745+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81430d0 con 0x7f42c0004800 2024-04-26T21:37:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.746+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d80b5d20 con 0x7f42c0004800 2024-04-26T21:37:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.747+0000 7f42d2000640 1 -- 172.21.15.5:0/2629572562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42cc01a020 con 0x7f42c0004800 2024-04-26T21:37:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.748+0000 7f42d2000640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42bc06c8f0 0x7f42bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.748+0000 7f42d2000640 1 -- 172.21.15.5:0/2629572562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f42cc08b660 con 0x7f42c0004800 2024-04-26T21:37:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.749+0000 7f42dd400640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42bc06c8f0 0x7f42bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.750+0000 7f42dd400640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42bc06c8f0 0x7f42bc06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42c8032000 tx=0x7f42c8009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:22.753+0000 7f42d2000640 1 -- 172.21.15.5:0/2629572562 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f42d80b5d20 con 0x7f42c0004800 2024-04-26T21:37:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.002+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42d8075db0 con 0x7f42c0004800 2024-04-26T21:37:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.003+0000 7f42d2000640 1 -- 172.21.15.5:0/2629572562 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3529 (secure 0 0 0) 0x7f42cc0597e0 con 0x7f42c0004800 2024-04-26T21:37:23.003 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:23.004 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:21.940890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T21:37:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-04-26T21:37:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.007+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42bc06c8f0 msgr2=0x7f42bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.007+0000 7f42df200640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42bc06c8f0 0x7f42bc06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42c8032000 tx=0x7f42c8009030 comp rx=0 tx=0).stop 2024-04-26T21:37:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.007+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 msgr2=0x7f42d8142790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.007+0000 7f42df200640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42d8142790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00d7a0 tx=0x7f42cc00dc60 comp rx=0 tx=0).stop 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 shutdown_connections 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42d81dca80 0x7f42d81dcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42d8141340 0x7f42d813d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42bc06c8f0 0x7f42bc06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 --2- 172.21.15.5:0/2629572562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c0004800 0x7f42d8142790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 >> 172.21.15.5:0/2629572562 conn(0x7f42d806c300 msgr2=0x7f42d80b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 shutdown_connections 2024-04-26T21:37:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.008+0000 7f42df200640 1 -- 172.21.15.5:0/2629572562 wait complete. 2024-04-26T21:37:23.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:23.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.219+0000 7f1884c00640 1 Processor -- start 2024-04-26T21:37:23.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.219+0000 7f1884c00640 1 -- start start 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.220+0000 7f1884c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18800b6e60 0x7f1880149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f1884c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18800b7240 con 0x7f188014a230 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f1884c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18800709f0 con 0x7f18801405c0 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f1884c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1880071b40 con 0x7f18800b6e60 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f187f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18800b6e60 0x7f1880149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f187f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18800b6e60 0x7f1880149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40840/0 (socket says 172.21.15.5:40840) 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f187ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f188014a230 0x7f188013feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55810/0 (socket says 172.21.15.5:55810) 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f187f400640 1 -- 172.21.15.5:0/4024432592 learned_addr learned my addr 172.21.15.5:0/4024432592 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:23.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f187f400640 1 -- 172.21.15.5:0/4024432592 >> v1:172.21.15.112:6789/0 conn(0x7f18801405c0 legacy=0x7f1880150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:23.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f187f400640 1 -- 172.21.15.5:0/4024432592 >> v1:172.21.15.5:6789/0 conn(0x7f188014a230 legacy=0x7f188013feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.221+0000 7f187f400640 1 -- 172.21.15.5:0/4024432592 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1880070710 con 0x7f18800b6e60 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.222+0000 7f187f400640 1 --2- 172.21.15.5:0/4024432592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18800b6e60 0x7f1880149cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1870009870 tx=0x7f187002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93708d7c36f1fe45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f187e000640 1 -- 172.21.15.5:0/4024432592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870037070 con 0x7f18800b6e60 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f187e000640 1 -- 172.21.15.5:0/4024432592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870032440 con 0x7f18800b6e60 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f187e000640 1 -- 172.21.15.5:0/4024432592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870032810 con 0x7f18800b6e60 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f1884c00640 1 -- 172.21.15.5:0/4024432592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18800b6e60 msgr2=0x7f1880149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f1884c00640 1 --2- 172.21.15.5:0/4024432592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18800b6e60 0x7f1880149cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1870009870 tx=0x7f187002a210 comp rx=0 tx=0).stop 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f1884c00640 1 -- 172.21.15.5:0/4024432592 shutdown_connections 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f1884c00640 1 --2- 172.21.15.5:0/4024432592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18800b6e60 0x7f1880149cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f1884c00640 1 -- 172.21.15.5:0/4024432592 >> 172.21.15.5:0/4024432592 conn(0x7f18800ba0f0 msgr2=0x7f18800b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:23.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f1884c00640 1 -- 172.21.15.5:0/4024432592 shutdown_connections 2024-04-26T21:37:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.223+0000 7f1884c00640 1 -- 172.21.15.5:0/4024432592 wait complete. 2024-04-26T21:37:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.225+0000 7f1884c00640 1 Processor -- start 2024-04-26T21:37:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.225+0000 7f1884c00640 1 -- start start 2024-04-26T21:37:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f1884c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18800b6e60 0x7f188013c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f1884c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18801405c0 0x7f18801e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f1884c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188014a230 0x7f18800ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f1884c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18800b3f50 con 0x7f18801405c0 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f1884c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18800b3dd0 con 0x7f188014a230 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f1884c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f18800b0a40 con 0x7f18800b6e60 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f187ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18801405c0 0x7f18801e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f187ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18801405c0 0x7f18801e0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40854/0 (socket says 172.21.15.5:40854) 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f187ea00640 1 -- 172.21.15.5:0/2139479704 learned_addr learned my addr 172.21.15.5:0/2139479704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.226+0000 7f187f400640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18800b6e60 0x7f188013c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187ea00640 1 -- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18800b6e60 msgr2=0x7f188013c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187fe00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188014a230 0x7f18800ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187ea00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18800b6e60 0x7f188013c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187ea00640 1 -- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188014a230 msgr2=0x7f18800ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187ea00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188014a230 0x7f18800ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187ea00640 1 -- 172.21.15.5:0/2139479704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1880147d20 con 0x7f18801405c0 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187f400640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18800b6e60 0x7f188013c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f187ea00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18801405c0 0x7f18801e0f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c3c0 tx=0x7f186c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f1877400640 1 -- 172.21.15.5:0/2139479704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c0074e0 con 0x7f18801405c0 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f1877400640 1 -- 172.21.15.5:0/2139479704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186c007680 con 0x7f18801405c0 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f1877400640 1 -- 172.21.15.5:0/2139479704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c004a00 con 0x7f18801405c0 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18800af8f0 con 0x7f18801405c0 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.227+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18800b2060 con 0x7f18801405c0 2024-04-26T21:37:23.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.229+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1880075db0 con 0x7f18801405c0 2024-04-26T21:37:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.229+0000 7f1877400640 1 -- 172.21.15.5:0/2139479704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f186c01a020 con 0x7f18801405c0 2024-04-26T21:37:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.230+0000 7f1877400640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f186006c920 0x7f186006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.230+0000 7f1877400640 1 -- 172.21.15.5:0/2139479704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f186c08b5e0 con 0x7f18801405c0 2024-04-26T21:37:23.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.231+0000 7f187f400640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f186006c920 0x7f186006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.232+0000 7f187f400640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f186006c920 0x7f186006ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1870034000 tx=0x7f187002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.235+0000 7f1877400640 1 -- 172.21.15.5:0/2139479704 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f186c0596c0 con 0x7f18801405c0 2024-04-26T21:37:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.443+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18801e1490 con 0x7f18801405c0 2024-04-26T21:37:23.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.445+0000 7f1877400640 1 -- 172.21.15.5:0/2139479704 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f186c058fc0 con 0x7f18801405c0 2024-04-26T21:37:23.446 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:23.446 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.447+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f186006c920 msgr2=0x7f186006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.447+0000 7f1884c00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f186006c920 0x7f186006ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1870034000 tx=0x7f187002e000 comp rx=0 tx=0).stop 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18801405c0 msgr2=0x7f18801e0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18801405c0 0x7f18801e0f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c3c0 tx=0x7f186c00c880 comp rx=0 tx=0).stop 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 shutdown_connections 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188014a230 0x7f18800ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f186006c920 0x7f186006ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18801405c0 0x7f18801e0f50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 --2- 172.21.15.5:0/2139479704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18800b6e60 0x7f188013c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 >> 172.21.15.5:0/2139479704 conn(0x7f18800ba0f0 msgr2=0x7f18800b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 shutdown_connections 2024-04-26T21:37:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.448+0000 7f1884c00640 1 -- 172.21.15.5:0/2139479704 wait complete. 2024-04-26T21:37:23.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:23.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.680+0000 7f8b4d400640 1 Processor -- start 2024-04-26T21:37:23.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.680+0000 7f8b4d400640 1 -- start start 2024-04-26T21:37:23.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.681+0000 7f8b4d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b480b3360 0x7f8b48146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.681+0000 7f8b4d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b48073d20 0x7f8b48150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.681+0000 7f8b4d400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b48070bc0 con 0x7f8b480b5fc0 2024-04-26T21:37:23.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.681+0000 7f8b4d400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8b480b43e0 con 0x7f8b480b3360 2024-04-26T21:37:23.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.681+0000 7f8b4d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8b48071c20 con 0x7f8b48073d20 2024-04-26T21:37:23.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.681+0000 7f8b47e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b480b3360 0x7f8b48146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.682+0000 7f8b47e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b480b3360 0x7f8b48146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40860/0 (socket says 172.21.15.5:40860) 2024-04-26T21:37:23.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.682+0000 7f8b47e00640 1 -- 172.21.15.5:0/182328539 learned_addr learned my addr 172.21.15.5:0/182328539 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.682+0000 7f8b47e00640 1 -- 172.21.15.5:0/182328539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b48073d20 msgr2=0x7f8b48150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.682+0000 7f8b4ca00640 1 --2- 172.21.15.5:0/182328539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b48073d20 0x7f8b48150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.682+0000 7f8b47e00640 1 --2- 172.21.15.5:0/182328539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b48073d20 0x7f8b48150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.682+0000 7f8b47e00640 1 -- 172.21.15.5:0/182328539 >> v1:172.21.15.112:6789/0 conn(0x7f8b480b5fc0 legacy=0x7f8b48073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.682+0000 7f8b47e00640 1 -- 172.21.15.5:0/182328539 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b480b3740 con 0x7f8b480b3360 2024-04-26T21:37:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.683+0000 7f8b47e00640 1 --2- 172.21.15.5:0/182328539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b48146a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b4806df50 tx=0x7f8b3802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef82819a840f4df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.683+0000 7f8b46a00640 1 -- 172.21.15.5:0/182328539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38036070 con 0x7f8b480b3360 2024-04-26T21:37:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.683+0000 7f8b46a00640 1 -- 172.21.15.5:0/182328539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b38031600 con 0x7f8b480b3360 2024-04-26T21:37:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.683+0000 7f8b46a00640 1 -- 172.21.15.5:0/182328539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b380319d0 con 0x7f8b480b3360 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 -- 172.21.15.5:0/182328539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 msgr2=0x7f8b48146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 --2- 172.21.15.5:0/182328539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b48146a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b4806df50 tx=0x7f8b3802a6f0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 -- 172.21.15.5:0/182328539 shutdown_connections 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 --2- 172.21.15.5:0/182328539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b48073d20 0x7f8b48150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 --2- 172.21.15.5:0/182328539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b48146a40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 -- 172.21.15.5:0/182328539 >> 172.21.15.5:0/182328539 conn(0x7f8b4806c300 msgr2=0x7f8b4806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 -- 172.21.15.5:0/182328539 shutdown_connections 2024-04-26T21:37:23.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.684+0000 7f8b4d400640 1 -- 172.21.15.5:0/182328539 wait complete. 2024-04-26T21:37:23.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.686+0000 7f8b4d400640 1 Processor -- start 2024-04-26T21:37:23.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.687+0000 7f8b4d400640 1 -- start start 2024-04-26T21:37:23.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b4d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b48073d20 0x7f8b48141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b4d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b480b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b4d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b480b5fc0 0x7f8b480b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b4d400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4806ebc0 con 0x7f8b480b3360 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b4d400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48146520 con 0x7f8b48073d20 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b4d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8b480b3d10 con 0x7f8b480b5fc0 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b480b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b480b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40868/0 (socket says 172.21.15.5:40868) 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b47400640 1 -- 172.21.15.5:0/3556226014 learned_addr learned my addr 172.21.15.5:0/3556226014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b47e00640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b48073d20 0x7f8b48141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.688+0000 7f8b4ca00640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b480b5fc0 0x7f8b480b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b47400640 1 -- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b480b5fc0 msgr2=0x7f8b480b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b47400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b480b5fc0 0x7f8b480b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b47400640 1 -- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b48073d20 msgr2=0x7f8b48141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b47400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b48073d20 0x7f8b48141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b47400640 1 -- 172.21.15.5:0/3556226014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b48143ce0 con 0x7f8b480b3360 2024-04-26T21:37:23.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b47400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b480b14e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000b3c0 tx=0x7f8b3000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b3fe00640 1 -- 172.21.15.5:0/3556226014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30011830 con 0x7f8b480b3360 2024-04-26T21:37:23.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b3fe00640 1 -- 172.21.15.5:0/3556226014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b30016070 con 0x7f8b480b3360 2024-04-26T21:37:23.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b3fe00640 1 -- 172.21.15.5:0/3556226014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30011c30 con 0x7f8b480b3360 2024-04-26T21:37:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b48142ba0 con 0x7f8b480b3360 2024-04-26T21:37:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.689+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b480b2c00 con 0x7f8b480b3360 2024-04-26T21:37:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.691+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b48075db0 con 0x7f8b480b3360 2024-04-26T21:37:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.692+0000 7f8b3fe00640 1 -- 172.21.15.5:0/3556226014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b3001b460 con 0x7f8b480b3360 2024-04-26T21:37:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.692+0000 7f8b3fe00640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8b2406c8f0 0x7f8b2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.693+0000 7f8b3fe00640 1 -- 172.21.15.5:0/3556226014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8b3008bb40 con 0x7f8b480b3360 2024-04-26T21:37:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.693+0000 7f8b47e00640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8b2406c8f0 0x7f8b2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.694+0000 7f8b47e00640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8b2406c8f0 0x7f8b2406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b38033000 tx=0x7f8b38009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.697+0000 7f8b3fe00640 1 -- 172.21.15.5:0/3556226014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8b30059c20 con 0x7f8b480b3360 2024-04-26T21:37:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.900+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b480b4ea0 con 0x7f8b480b3360 2024-04-26T21:37:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.902+0000 7f8b3fe00640 1 -- 172.21.15.5:0/3556226014 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f8b30059520 con 0x7f8b480b3360 2024-04-26T21:37:23.903 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:23.903 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8b2406c8f0 msgr2=0x7f8b2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8b2406c8f0 0x7f8b2406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b38033000 tx=0x7f8b38009000 comp rx=0 tx=0).stop 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 msgr2=0x7f8b480b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b480b14e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000b3c0 tx=0x7f8b3000b880 comp rx=0 tx=0).stop 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 shutdown_connections 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8b480b5fc0 0x7f8b480b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8b2406c8f0 0x7f8b2406edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b480b3360 0x7f8b480b14e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 --2- 172.21.15.5:0/3556226014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b48073d20 0x7f8b48141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 >> 172.21.15.5:0/3556226014 conn(0x7f8b4806c300 msgr2=0x7f8b480ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 shutdown_connections 2024-04-26T21:37:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:23.905+0000 7f8b4d400640 1 -- 172.21.15.5:0/3556226014 wait complete. 2024-04-26T21:37:23.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:37:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.155+0000 7f7fc3e00640 1 Processor -- start 2024-04-26T21:37:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.156+0000 7f7fc3e00640 1 -- start start 2024-04-26T21:37:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.157+0000 7f7fc3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fc40bae80 0x7f7fc40b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.157+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 0x7f7fc41427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.157+0000 7f7fc3e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc40bb260 con 0x7f7fc4142310 2024-04-26T21:37:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.157+0000 7f7fc3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc40b6270 con 0x7f7fc40bae80 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.157+0000 7f7fc3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc40b6550 con 0x7f7fc4148d10 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.157+0000 7f7fc2000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7fc4142310 0x7f7fc4148600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55826/0 (socket says 172.21.15.5:55826) 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.157+0000 7f7fc2000640 1 -- 172.21.15.5:0/2628995937 learned_addr learned my addr 172.21.15.5:0/2628995937 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/2628995937 >> v2:172.21.15.112:3300/0 conn(0x7f7fc40bae80 0x7f7fc40b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc3400640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 0x7f7fc41427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455880012 0 0) 0x7f7fc40bb260 con 0x7f7fc4142310 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa8003520 con 0x7f7fc4142310 2024-04-26T21:37:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2655749877 0 0) 0x7f7fa8003520 con 0x7f7fc4142310 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 msgr2=0x7f7fc41427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 0x7f7fc41427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 >> v2:172.21.15.112:3300/0 conn(0x7f7fc40bae80 msgr2=0x7f7fc40b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 --2- 172.21.15.5:0/2628995937 >> v2:172.21.15.112:3300/0 conn(0x7f7fc40bae80 0x7f7fc40b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc40b6830 con 0x7f7fc4142310 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f7fac001670 con 0x7f7fc4142310 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.158+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 >> v1:172.21.15.5:6789/0 conn(0x7f7fc4142310 legacy=0x7f7fc4148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc1600640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa80039b0 0x7f7fa8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc1600640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 0x7f7fa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc1600640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa8004d40 0x7f7fa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40b6270 con 0x7f7fa80039b0 2024-04-26T21:37:24.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40b6550 con 0x7f7fa8004d40 2024-04-26T21:37:24.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa800b9f0 con 0x7f7fc4148d10 2024-04-26T21:37:24.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa80039b0 0x7f7fa8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc2000640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 0x7f7fa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc3400640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa8004d40 0x7f7fa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc2a00640 1 -- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 msgr2=0x7f7fa8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:24.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fc4148d10 0x7f7fa8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc2a00640 1 -- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa8004d40 msgr2=0x7f7fa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:24.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa8004d40 0x7f7fa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.159+0000 7f7fc2a00640 1 -- 172.21.15.5:0/2628995937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa8003520 con 0x7f7fa80039b0 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.160+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa80039b0 0x7f7fa8003dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009ac0 tx=0x7f7fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8d73fe4d401937 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4036070 con 0x7f7fa80039b0 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb4031400 con 0x7f7fa80039b0 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc1600640 1 -- 172.21.15.5:0/2628995937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4009690 con 0x7f7fa80039b0 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc3e00640 1 -- 172.21.15.5:0/2628995937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa80039b0 msgr2=0x7f7fa8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc3e00640 1 --2- 172.21.15.5:0/2628995937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa80039b0 0x7f7fa8003dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009ac0 tx=0x7f7fa8005830 comp rx=0 tx=0).stop 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc3400640 1 -- 172.21.15.5:0/2628995937 reap_dead start 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc3e00640 1 -- 172.21.15.5:0/2628995937 shutdown_connections 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.161+0000 7f7fc3e00640 1 -- 172.21.15.5:0/2628995937 >> 172.21.15.5:0/2628995937 conn(0x7f7fc40684b0 msgr2=0x7f7fc40688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.162+0000 7f7fc3e00640 1 -- 172.21.15.5:0/2628995937 shutdown_connections 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.162+0000 7f7fc3e00640 1 -- 172.21.15.5:0/2628995937 wait complete. 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.163+0000 7f7fc3e00640 1 Processor -- start 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.163+0000 7f7fc3e00640 1 -- start start 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fa80039b0 0x7f7fc4143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fc4145760 0x7f7fc4145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fc41dd850 0x7f7fc41ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4142920 con 0x7f7fc4145760 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41427a0 con 0x7f7fc41dd850 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc4142aa0 con 0x7f7fa80039b0 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fc4145760 0x7f7fc4145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fc4145760 0x7f7fc4145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40894/0 (socket says 172.21.15.5:40894) 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.164+0000 7f7fc2000640 1 -- 172.21.15.5:0/1009886519 learned_addr learned my addr 172.21.15.5:0/1009886519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:24.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fa80039b0 0x7f7fc4143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc3400640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fc41dd850 0x7f7fc41ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc2000640 1 -- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fa80039b0 msgr2=0x7f7fc4143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc2000640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fa80039b0 0x7f7fc4143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc2000640 1 -- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fc41dd850 msgr2=0x7f7fc41ddcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc2000640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fc41dd850 0x7f7fc41ddcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc2000640 1 -- 172.21.15.5:0/1009886519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc414c2e0 con 0x7f7fc4145760 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc3400640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fc41dd850 0x7f7fc41ddcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc2000640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fc4145760 0x7f7fc4145be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fac001050 tx=0x7f7fac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fbaa00640 1 -- 172.21.15.5:0/1009886519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00c870 con 0x7f7fc4145760 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fbaa00640 1 -- 172.21.15.5:0/1009886519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fac018070 con 0x7f7fc4145760 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fbaa00640 1 -- 172.21.15.5:0/1009886519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00cc50 con 0x7f7fc4145760 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.165+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc414c890 con 0x7f7fc4145760 2024-04-26T21:37:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.166+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc4144cf0 con 0x7f7fc4145760 2024-04-26T21:37:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.167+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc4075db0 con 0x7f7fc4145760 2024-04-26T21:37:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.168+0000 7f7fbaa00640 1 -- 172.21.15.5:0/1009886519 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fac01d460 con 0x7f7fc4145760 2024-04-26T21:37:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.169+0000 7f7fbaa00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.169+0000 7f7fbaa00640 1 -- 172.21.15.5:0/1009886519 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7fac08bd80 con 0x7f7fc4145760 2024-04-26T21:37:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.170+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.171+0000 7f7fc2a00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7fa006c8f0 0x7f7fa006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4033000 tx=0x7f7fb4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.174+0000 7f7fbaa00640 1 -- 172.21.15.5:0/1009886519 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7fac059f00 con 0x7f7fc4145760 2024-04-26T21:37:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.418+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fc40b8890 con 0x7f7fc4145760 2024-04-26T21:37:24.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.419+0000 7f7fbaa00640 1 -- 172.21.15.5:0/1009886519 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3529 (secure 0 0 0) 0x7f7fac059800 con 0x7f7fc4145760 2024-04-26T21:37:24.420 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:24.420 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:21.940890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T21:37:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-04-26T21:37:24.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7fa006c8f0 msgr2=0x7f7fa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7fa006c8f0 0x7f7fa006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4033000 tx=0x7f7fb4008030 comp rx=0 tx=0).stop 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fc4145760 msgr2=0x7f7fc4145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fc4145760 0x7f7fc4145be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fac001050 tx=0x7f7fac00eca0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 shutdown_connections 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fc41dd850 0x7f7fc41ddcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fc4145760 0x7f7fc4145be0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 --2- 172.21.15.5:0/1009886519 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7fa80039b0 0x7f7fc4143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 >> 172.21.15.5:0/1009886519 conn(0x7f7fc40684b0 msgr2=0x7f7fc4075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.422+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 shutdown_connections 2024-04-26T21:37:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.423+0000 7f7fc3e00640 1 -- 172.21.15.5:0/1009886519 wait complete. 2024-04-26T21:37:24.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.646+0000 7f45ffe00640 1 Processor -- start 2024-04-26T21:37:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.646+0000 7f45ffe00640 1 -- start start 2024-04-26T21:37:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.647+0000 7f45ffe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46000b4650 0x7f46000b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.647+0000 7f45ffe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f460013f0a0 0x7f460013f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.647+0000 7f45ffe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46000b4a30 con 0x7f46000b0ee0 2024-04-26T21:37:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.647+0000 7f45ffe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4600145810 con 0x7f460013f0a0 2024-04-26T21:37:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.647+0000 7f45ffe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4600070740 con 0x7f46000b4650 2024-04-26T21:37:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45ff400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f460013f0a0 0x7f460013f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45ff400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f460013f0a0 0x7f460013f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37966/0 (socket says 172.21.15.5:37966) 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45ff400640 1 -- 172.21.15.5:0/72838938 learned_addr learned my addr 172.21.15.5:0/72838938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45fe000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f46000b0ee0 0x7f4600145ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37376/0 (socket says 172.21.15.5:37376) 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45fea00640 1 --2- 172.21.15.5:0/72838938 >> v2:172.21.15.112:3300/0 conn(0x7f46000b4650 0x7f46000b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45ff400640 1 -- 172.21.15.5:0/72838938 >> v2:172.21.15.112:3300/0 conn(0x7f46000b4650 msgr2=0x7f46000b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45ff400640 1 --2- 172.21.15.5:0/72838938 >> v2:172.21.15.112:3300/0 conn(0x7f46000b4650 0x7f46000b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45ff400640 1 -- 172.21.15.5:0/72838938 >> v1:172.21.15.5:6789/0 conn(0x7f46000b0ee0 legacy=0x7f4600145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.648+0000 7f45ff400640 1 -- 172.21.15.5:0/72838938 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46000b3720 con 0x7f460013f0a0 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.649+0000 7f45ff400640 1 --2- 172.21.15.5:0/72838938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f460013f550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f46000b74b0 tx=0x7f45f802c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf55ae84c718fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.649+0000 7f45fd600640 1 -- 172.21.15.5:0/72838938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8009600 con 0x7f460013f0a0 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.649+0000 7f45fd600640 1 -- 172.21.15.5:0/72838938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f80097a0 con 0x7f460013f0a0 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.649+0000 7f45fd600640 1 -- 172.21.15.5:0/72838938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8009b70 con 0x7f460013f0a0 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 -- 172.21.15.5:0/72838938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 msgr2=0x7f460013f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 --2- 172.21.15.5:0/72838938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f460013f550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f46000b74b0 tx=0x7f45f802c8c0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 -- 172.21.15.5:0/72838938 shutdown_connections 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 --2- 172.21.15.5:0/72838938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f460013f550 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 --2- 172.21.15.5:0/72838938 >> v2:172.21.15.112:3300/0 conn(0x7f46000b4650 0x7f46000b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 -- 172.21.15.5:0/72838938 >> 172.21.15.5:0/72838938 conn(0x7f460006c300 msgr2=0x7f460006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 -- 172.21.15.5:0/72838938 shutdown_connections 2024-04-26T21:37:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.650+0000 7f45ffe00640 1 -- 172.21.15.5:0/72838938 wait complete. 2024-04-26T21:37:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.652+0000 7f45ffe00640 1 Processor -- start 2024-04-26T21:37:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.652+0000 7f45ffe00640 1 -- start start 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ffe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46000b0ee0 0x7f46000b8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ffe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46000b4650 0x7f46001432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f46001437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ffe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f46000b4c70 con 0x7f460013f0a0 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ffe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f46000b0ad0 con 0x7f46000b4650 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ffe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f46000b4df0 con 0x7f46000b0ee0 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f46001437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f46001437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37980/0 (socket says 172.21.15.5:37980) 2024-04-26T21:37:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.653+0000 7f45ff400640 1 -- 172.21.15.5:0/3612501543 learned_addr learned my addr 172.21.15.5:0/3612501543 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45fea00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46000b0ee0 0x7f46000b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45ff400640 1 -- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46000b0ee0 msgr2=0x7f46000b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45ff400640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46000b0ee0 0x7f46000b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45ff400640 1 -- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46000b4650 msgr2=0x7f46001432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45ff400640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46000b4650 0x7f46001432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45ff400640 1 -- 172.21.15.5:0/3612501543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46001450f0 con 0x7f460013f0a0 2024-04-26T21:37:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45ff400640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f46001437f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f45f802ceb0 tx=0x7f45f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45f6a00640 1 -- 172.21.15.5:0/3612501543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8042020 con 0x7f460013f0a0 2024-04-26T21:37:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45f6a00640 1 -- 172.21.15.5:0/3612501543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8009370 con 0x7f460013f0a0 2024-04-26T21:37:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45f6a00640 1 -- 172.21.15.5:0/3612501543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8009600 con 0x7f460013f0a0 2024-04-26T21:37:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.654+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46000b05c0 con 0x7f460013f0a0 2024-04-26T21:37:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.655+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46001cb560 con 0x7f460013f0a0 2024-04-26T21:37:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.656+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4600075db0 con 0x7f460013f0a0 2024-04-26T21:37:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.657+0000 7f45f6a00640 1 -- 172.21.15.5:0/3612501543 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45f8045020 con 0x7f460013f0a0 2024-04-26T21:37:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.658+0000 7f45f6a00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.658+0000 7f45f6a00640 1 -- 172.21.15.5:0/3612501543 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f45f80ad290 con 0x7f460013f0a0 2024-04-26T21:37:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.659+0000 7f45fea00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:24.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.660+0000 7f45fea00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f45e006c8f0 0x7f45e006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45f0006fd0 tx=0x7f45f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:24.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.663+0000 7f45f6a00640 1 -- 172.21.15.5:0/3612501543 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f45f804c030 con 0x7f460013f0a0 2024-04-26T21:37:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.867+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f460006df60 con 0x7f460013f0a0 2024-04-26T21:37:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.869+0000 7f45f6a00640 1 -- 172.21.15.5:0/3612501543 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f45f8081030 con 0x7f460013f0a0 2024-04-26T21:37:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:24.870 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.871+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f45e006c8f0 msgr2=0x7f45e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.871+0000 7f45ffe00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f45e006c8f0 0x7f45e006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45f0006fd0 tx=0x7f45f0008040 comp rx=0 tx=0).stop 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.871+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 msgr2=0x7f46001437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.871+0000 7f45ffe00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f46001437f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f45f802ceb0 tx=0x7f45f8004a40 comp rx=0 tx=0).stop 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 shutdown_connections 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f460013f0a0 0x7f46001437f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46000b4650 0x7f46001432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 --2- 172.21.15.5:0/3612501543 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46000b0ee0 0x7f46000b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 >> 172.21.15.5:0/3612501543 conn(0x7f460006c300 msgr2=0x7f4600075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 shutdown_connections 2024-04-26T21:37:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:24.872+0000 7f45ffe00640 1 -- 172.21.15.5:0/3612501543 wait complete. 2024-04-26T21:37:25.092 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:37:16.886712+0000', 'modified': '2024-04-26T21:37:21.940890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6835/1466535528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1466535528}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 1466535528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-04-26T21:37:25.092 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:37:25.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T21:37:25.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.314+0000 7f82e7e00640 1 Processor -- start 2024-04-26T21:37:25.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.314+0000 7f82e7e00640 1 -- start start 2024-04-26T21:37:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.315+0000 7f82e7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f82e00b6d50 0x7f82e0146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.315+0000 7f82e7e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e0070d90 con 0x7f82e01469c0 2024-04-26T21:37:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.315+0000 7f82e7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e00b0780 con 0x7f82e0073ce0 2024-04-26T21:37:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.315+0000 7f82e7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f82e00b7130 con 0x7f82e00b6d50 2024-04-26T21:37:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82e4a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f82e01469c0 0x7f82e00735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37378/0 (socket says 172.21.15.5:37378) 2024-04-26T21:37:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82e4a00640 1 -- 172.21.15.5:0/3122564395 learned_addr learned my addr 172.21.15.5:0/3122564395 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82e5400640 1 --2- 172.21.15.5:0/3122564395 >> v2:172.21.15.112:3300/0 conn(0x7f82e00b6d50 0x7f82e0146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568382809 0 0) 0x7f82e0070d90 con 0x7f82e01469c0 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c8003520 con 0x7f82e01469c0 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2546956939 0 0) 0x7f82c8003520 con 0x7f82e01469c0 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 >> v2:172.21.15.112:3300/0 conn(0x7f82e00b6d50 msgr2=0x7f82e0146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 --2- 172.21.15.5:0/3122564395 >> v2:172.21.15.112:3300/0 conn(0x7f82e00b6d50 0x7f82e0146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 >> v1:172.21.15.112:6789/0 conn(0x7f82e0073ce0 legacy=0x7f82e0150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e00b0a20 con 0x7f82e01469c0 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.316+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f82cc001670 con 0x7f82e01469c0 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 >> v1:172.21.15.5:6789/0 conn(0x7f82e01469c0 legacy=0x7f82e00735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82dfe00640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c80039b0 0x7f82c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82dfe00640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c8004800 0x7f82c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82dfe00640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80051c0 0x7f82c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82e00b7130 con 0x7f82c80039b0 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f82c800c160 con 0x7f82c80051c0 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f82c800c360 con 0x7f82c8004800 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5400640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c80039b0 0x7f82c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c8004800 0x7f82c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5e00640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80051c0 0x7f82c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5400640 1 -- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c8004800 msgr2=0x7f82c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5400640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c8004800 0x7f82c8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5400640 1 -- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80051c0 msgr2=0x7f82c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5400640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80051c0 0x7f82c800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5400640 1 -- 172.21.15.5:0/3122564395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8003520 con 0x7f82c80039b0 2024-04-26T21:37:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.317+0000 7f82e5e00640 1 -- 172.21.15.5:0/3122564395 reap_dead start 2024-04-26T21:37:25.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.318+0000 7f82e5400640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c80039b0 0x7f82c8003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009ac0 tx=0x7f82c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e500be7593ca0d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4036070 con 0x7f82c80039b0 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d4031400 con 0x7f82c80039b0 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82dfe00640 1 -- 172.21.15.5:0/3122564395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4009690 con 0x7f82c80039b0 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82e7e00640 1 -- 172.21.15.5:0/3122564395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c80039b0 msgr2=0x7f82c8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c80039b0 0x7f82c8003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009ac0 tx=0x7f82c8005830 comp rx=0 tx=0).stop 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82e7e00640 1 -- 172.21.15.5:0/3122564395 shutdown_connections 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3122564395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82c80039b0 0x7f82c8003dd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82e7e00640 1 -- 172.21.15.5:0/3122564395 >> 172.21.15.5:0/3122564395 conn(0x7f82e006c720 msgr2=0x7f82e006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82e7e00640 1 -- 172.21.15.5:0/3122564395 shutdown_connections 2024-04-26T21:37:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.319+0000 7f82e7e00640 1 -- 172.21.15.5:0/3122564395 wait complete. 2024-04-26T21:37:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.321+0000 7f82e7e00640 1 Processor -- start 2024-04-26T21:37:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.321+0000 7f82e7e00640 1 -- start start 2024-04-26T21:37:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80039b0 0x7f82e0142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e01442a0 0x7f82e0144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82e013f180 0x7f82e013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e7e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82e00b3bf0 con 0x7f82e01442a0 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f82e0070870 con 0x7f82c80039b0 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f82e00b4050 con 0x7f82e013f180 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e01442a0 0x7f82e0144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e01442a0 0x7f82e0144700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37996/0 (socket says 172.21.15.5:37996) 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e4a00640 1 -- 172.21.15.5:0/3232632778 learned_addr learned my addr 172.21.15.5:0/3232632778 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e5400640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80039b0 0x7f82e0142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.322+0000 7f82e5e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82e013f180 0x7f82e013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e4a00640 1 -- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82e013f180 msgr2=0x7f82e013f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82e013f180 0x7f82e013f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e4a00640 1 -- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80039b0 msgr2=0x7f82e0142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80039b0 0x7f82e0142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e4a00640 1 -- 172.21.15.5:0/3232632778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e0141dc0 con 0x7f82e01442a0 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e5e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82e013f180 0x7f82e013f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e01442a0 0x7f82e0144700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00d770 tx=0x7f82cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82dd600640 1 -- 172.21.15.5:0/3232632778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc019070 con 0x7f82e01442a0 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82dd600640 1 -- 172.21.15.5:0/3232632778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc0074e0 con 0x7f82e01442a0 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82dd600640 1 -- 172.21.15.5:0/3232632778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc004a20 con 0x7f82e01442a0 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e01439b0 con 0x7f82e01442a0 2024-04-26T21:37:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.323+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e0141160 con 0x7f82e01442a0 2024-04-26T21:37:25.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.326+0000 7f82dd600640 1 -- 172.21.15.5:0/3232632778 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82cc01c070 con 0x7f82e01442a0 2024-04-26T21:37:25.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.327+0000 7f82dd600640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f82c006c920 0x7f82c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.327+0000 7f82dd600640 1 -- 172.21.15.5:0/3232632778 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82cc08b8b0 con 0x7f82e01442a0 2024-04-26T21:37:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.327+0000 7f82eadc9740 1 Processor -- start 2024-04-26T21:37:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.327+0000 7f82e5400640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f82c006c920 0x7f82c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.327+0000 7f82eadc9740 1 -- start start 2024-04-26T21:37:25.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.328+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c614e80 0x55ad0c610f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.328+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c612530 0x55ad0c63ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.328+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c63d380 0x55ad0c63d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.328+0000 7f82eadc9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ad0c579600 con 0x55ad0c63d380 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.328+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ad0c516100 con 0x55ad0c614e80 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.328+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55ad0c5755c0 con 0x55ad0c612530 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.328+0000 7f82e5400640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f82c006c920 0x7f82c006ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f82d4033000 tx=0x7f82d4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c614e80 0x55ad0c610f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c614e80 0x55ad0c610f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:60970/0 (socket says 172.21.15.5:60970) 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5400640 1 -- 172.21.15.5:0/2576208517 learned_addr learned my addr 172.21.15.5:0/2576208517 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5e00640 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c63d380 0x55ad0c63d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e4a00640 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c612530 0x55ad0c63ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5e00640 1 -- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c612530 msgr2=0x55ad0c63ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5e00640 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c612530 0x55ad0c63ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5e00640 1 -- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c614e80 msgr2=0x55ad0c610f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5e00640 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c614e80 0x55ad0c610f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e5e00640 1 -- 172.21.15.5:0/2576208517 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0c28b2d0 con 0x55ad0c63d380 2024-04-26T21:37:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.329+0000 7f82e4a00640 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c612530 0x55ad0c63ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.330+0000 7f82e5e00640 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c63d380 0x55ad0c63d7c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82e00b3940 tx=0x7f82d8001f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b39c3444da0981 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.330+0000 7f82d1c00640 1 -- 172.21.15.5:0/2576208517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d8003d80 con 0x55ad0c63d380 2024-04-26T21:37:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.330+0000 7f82d1c00640 1 -- 172.21.15.5:0/2576208517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d800e770 con 0x55ad0c63d380 2024-04-26T21:37:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.330+0000 7f82d1c00640 1 -- 172.21.15.5:0/2576208517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d800eb60 con 0x55ad0c63d380 2024-04-26T21:37:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 -- 172.21.15.5:0/2576208517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c63d380 msgr2=0x55ad0c63d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c63d380 0x55ad0c63d7c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82e00b3940 tx=0x7f82d8001f80 comp rx=0 tx=0).stop 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 -- 172.21.15.5:0/2576208517 shutdown_connections 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c63d380 0x55ad0c63d7c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c612530 0x55ad0c63ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 --2- 172.21.15.5:0/2576208517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c614e80 0x55ad0c610f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 -- 172.21.15.5:0/2576208517 >> 172.21.15.5:0/2576208517 conn(0x55ad0c5a9d10 msgr2=0x55ad0c6142a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 -- 172.21.15.5:0/2576208517 shutdown_connections 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 -- 172.21.15.5:0/2576208517 wait complete. 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.331+0000 7f82eadc9740 1 -- start start 2024-04-26T21:37:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.332+0000 7f82eadc9740 1 Processor -- start 2024-04-26T21:37:25.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c63f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c636900 0x55ad0c636d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82eadc9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ad0c642360 con 0x55ad0c614e80 2024-04-26T21:37:25.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ad0c500f70 con 0x55ad0c63d380 2024-04-26T21:37:25.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55ad0c610730 con 0x55ad0c636900 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82eadc9740 10 client.0 _ll_register_callbacks cb 0x55ad0c56f480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38018/0 (socket says 172.21.15.5:38018) 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 -- 172.21.15.5:0/3199054 learned_addr learned my addr 172.21.15.5:0/3199054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c63f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 -- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c636900 msgr2=0x55ad0c636d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c636900 0x55ad0c636d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 -- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 msgr2=0x55ad0c63f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c63f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e5400640 1 -- 172.21.15.5:0/3199054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0c3556b0 con 0x55ad0c614e80 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.333+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c63f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82e5400640 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6576d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82d4004680 tx=0x7f82d402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473070ef5dcc41b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82c6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82c6000640 1 -- 172.21.15.5:0/3199054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4036040 con 0x55ad0c614e80 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82c6000640 1 -- 172.21.15.5:0/3199054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82d403c670 con 0x55ad0c614e80 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82d800e770 con 0x55ad0c614e80 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82c6000640 1 -- 172.21.15.5:0/3199054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f82d4005990 con 0x55ad0c614e80 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82eadc9740 10 client.4371 fetch_fsmap learned FSMap version 7 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.334+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ad0c640ef0 con 0x55ad0c614e80 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82c6000640 1 -- 172.21.15.5:0/3199054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d800e770 con 0x55ad0c614e80 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82c6000640 1 -- 172.21.15.5:0/3199054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) ==== 2292+0+0 (secure 0 0 0) 0x7f82d4058080 con 0x55ad0c614e80 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82eadc9740 10 client.4371 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82eadc9740 10 client.4371 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82eadc9740 20 client.4371 populate_metadata read hostname 'smithi005' 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c654010 0x55ad0c654410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82eadc9740 4 client.4371 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:37:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.335+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 --> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad0c587210 con 0x55ad0c654010 2024-04-26T21:37:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.336+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c654010 0x55ad0c654410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.336+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c654010 0x55ad0c654410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ae1e406dcfce2d8 server_cookie=8732bce78b5767a4 in_seq=0 out_seq=0 2024-04-26T21:37:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.336+0000 7f82c6000640 10 client.4371 ms_handle_connect on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82c6000640 1 -- 172.21.15.5:0/3199054 <== mds.0 v2:172.21.15.112:6834/1466535528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ad0c587210 con 0x55ad0c654010 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82c6000640 10 client.4371 handle_command_reply: tid=0 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 client.4371 shutdown 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 msgr2=0x55ad0c6576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6576d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82d4004680 tx=0x7f82d402c000 comp rx=0 tx=0).stop 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 shutdown_connections 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c654010 0x55ad0c654410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c636900 0x55ad0c636d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c63f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3199054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6576d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82c6000640 0 client.4371 ms_handle_reset on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:25.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 >> 172.21.15.5:0/3199054 conn(0x55ad0c5a9d10 msgr2=0x55ad0c610ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 shutdown_connections 2024-04-26T21:37:25.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 1 -- 172.21.15.5:0/3199054 wait complete. 2024-04-26T21:37:25.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.338+0000 7f82eadc9740 20 client.4371 trim_cache size 0 max 16384 2024-04-26T21:37:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.358+0000 7f82eadc9740 1 Processor -- start 2024-04-26T21:37:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.358+0000 7f82eadc9740 1 -- start start 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c614e80 0x55ad0c646470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c636900 0x55ad0c6157a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c667b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82eadc9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82e01ec950 con 0x55ad0c636900 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f82e01eba70 con 0x55ad0c63d380 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55ad0c637770 con 0x55ad0c614e80 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82e4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c636900 0x55ad0c6157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82e4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c636900 0x55ad0c6157a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38032/0 (socket says 172.21.15.5:38032) 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.359+0000 7f82e4a00640 1 -- 172.21.15.5:0/3114630185 learned_addr learned my addr 172.21.15.5:0/3114630185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e5e00640 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c667b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e4a00640 1 -- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c614e80 msgr2=0x55ad0c646470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e5400640 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c614e80 0x55ad0c646470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c614e80 0x55ad0c646470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e4a00640 1 -- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 msgr2=0x55ad0c667b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c667b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e4a00640 1 -- 172.21.15.5:0/3114630185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0c644e30 con 0x55ad0c636900 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e5e00640 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c667b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82e4a00640 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c636900 0x55ad0c6157a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f82cc089a90 tx=0x7f82cc08b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce3f65800f7b081 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82d1200640 1 -- 172.21.15.5:0/3114630185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc089e60 con 0x55ad0c636900 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82d1200640 1 -- 172.21.15.5:0/3114630185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc089070 con 0x55ad0c636900 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.360+0000 7f82d1200640 1 -- 172.21.15.5:0/3114630185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc061e70 con 0x55ad0c636900 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 -- 172.21.15.5:0/3114630185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c636900 msgr2=0x55ad0c6157a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c636900 0x55ad0c6157a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f82cc089a90 tx=0x7f82cc08b040 comp rx=0 tx=0).stop 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 -- 172.21.15.5:0/3114630185 shutdown_connections 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c63d380 0x55ad0c667b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c636900 0x55ad0c6157a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 --2- 172.21.15.5:0/3114630185 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c614e80 0x55ad0c646470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 -- 172.21.15.5:0/3114630185 >> 172.21.15.5:0/3114630185 conn(0x55ad0c5a9d10 msgr2=0x55ad0c60fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 -- 172.21.15.5:0/3114630185 shutdown_connections 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 -- 172.21.15.5:0/3114630185 wait complete. 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.361+0000 7f82eadc9740 1 -- start start 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.362+0000 7f82eadc9740 1 Processor -- start 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.362+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.362+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c636900 0x55ad0c6b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82eadc9740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c63d380 0x55ad0c6b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82eadc9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ad0c52e600 con 0x55ad0c614e80 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ad0c63f9c0 con 0x55ad0c636900 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82eadc9740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55ad0c614b10 con 0x55ad0c63d380 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82eadc9740 10 client.0 _ll_register_callbacks cb 0x7f82c80036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38042/0 (socket says 172.21.15.5:38042) 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 -- 172.21.15.5:0/356619063 learned_addr learned my addr 172.21.15.5:0/356619063 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e4a00640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c636900 0x55ad0c6b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5e00640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c63d380 0x55ad0c6b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 -- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c63d380 msgr2=0x55ad0c6b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c63d380 0x55ad0c6b8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 -- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c636900 msgr2=0x55ad0c6b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c636900 0x55ad0c6b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5400640 1 -- 172.21.15.5:0/356619063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0c6453f0 con 0x55ad0c614e80 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.363+0000 7f82e5e00640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c63d380 0x55ad0c6b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82e5400640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6c1f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f82d400f210 tx=0x7f82d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f41deec5e1f303b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82c6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82c6000640 1 -- 172.21.15.5:0/356619063 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4036040 con 0x55ad0c614e80 2024-04-26T21:37:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82c6000640 1 -- 172.21.15.5:0/356619063 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82d403cd00 con 0x55ad0c614e80 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82cc089070 con 0x55ad0c614e80 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82c6000640 1 -- 172.21.15.5:0/356619063 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f82d4050350 con 0x55ad0c614e80 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82eadc9740 10 client.4377 fetch_fsmap learned FSMap version 7 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ad0c65a2c0 con 0x55ad0c614e80 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.364+0000 7f82c6000640 1 -- 172.21.15.5:0/356619063 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc089070 con 0x55ad0c614e80 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82c6000640 1 -- 172.21.15.5:0/356619063 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) ==== 2292+0+0 (secure 0 0 0) 0x7f82d40504f0 con 0x55ad0c614e80 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82eadc9740 10 client.4377 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82eadc9740 10 client.4377 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82eadc9740 20 client.4377 populate_metadata read hostname 'smithi005' 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82eadc9740 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c666f40 0x55ad0c637bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82eadc9740 4 client.4377 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:37:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 --> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] -- command(tid 0: {"prefix": "status"}) -- 0x55ad0c581080 con 0x55ad0c666f40 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.365+0000 7f82e4a00640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c666f40 0x55ad0c637bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.366+0000 7f82e4a00640 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c666f40 0x55ad0c637bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=725b7d0b5f70c55f server_cookie=89d263eefff68900 in_seq=0 out_seq=0 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.366+0000 7f82c6000640 10 client.4377 ms_handle_connect on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82c6000640 1 -- 172.21.15.5:0/356619063 <== mds.0 v2:172.21.15.112:6834/1466535528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55ad0c581080 con 0x55ad0c666f40 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82c6000640 10 client.4377 handle_command_reply: tid=0 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 client.4377 shutdown 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 msgr2=0x55ad0c6c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6c1f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f82d400f210 tx=0x7f82d40046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 shutdown_connections 2024-04-26T21:37:25.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55ad0c666f40 0x55ad0c637bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55ad0c63d380 0x55ad0c6b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ad0c636900 0x55ad0c6b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 --2- 172.21.15.5:0/356619063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad0c614e80 0x55ad0c6c1f50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82c6000640 0 client.4377 ms_handle_reset on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 >> 172.21.15.5:0/356619063 conn(0x55ad0c5a9d10 msgr2=0x55ad0c63fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 shutdown_connections 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 1 -- 172.21.15.5:0/356619063 wait complete. 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.367+0000 7f82eadc9740 20 client.4377 trim_cache size 0 max 16384 2024-04-26T21:37:25.372 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "a3a415d8-7c54-4abb-9c5e-72229b6eddf5", 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4294, 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 7.9579059360000004, 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 7, 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 24, 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.793072099 2024-04-26T21:37:25.373 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T21:37:25.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f82c006c920 msgr2=0x7f82c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f82c006c920 0x7f82c006ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f82d4033000 tx=0x7f82d4008030 comp rx=0 tx=0).stop 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e01442a0 msgr2=0x7f82e0144700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e01442a0 0x7f82e0144700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00d770 tx=0x7f82cc00dc30 comp rx=0 tx=0).stop 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 shutdown_connections 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82e013f180 0x7f82e013f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f82c006c920 0x7f82c006ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e01442a0 0x7f82e0144700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 --2- 172.21.15.5:0/3232632778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80039b0 0x7f82e0142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 >> 172.21.15.5:0/3232632778 conn(0x7f82e006c720 msgr2=0x7f82e01d46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 shutdown_connections 2024-04-26T21:37:25.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.368+0000 7f82e7e00640 1 -- 172.21.15.5:0/3232632778 wait complete. 2024-04-26T21:37:25.386 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:37:25.387 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:25.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:37:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.600+0000 7fc555400640 1 Processor -- start 2024-04-26T21:37:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.600+0000 7fc555400640 1 -- start start 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.602+0000 7fc555400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5500afb00 0x7fc5500b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.602+0000 7fc555400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b4d20 0x7fc5500b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.602+0000 7fc555400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5500b7240 con 0x7fc5500b6e60 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.602+0000 7fc555400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc5500af670 con 0x7fc5500afb00 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.602+0000 7fc555400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc5500b5d90 con 0x7fc5500b4d20 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.602+0000 7fc547e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5500afb00 0x7fc5500b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc547e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5500afb00 0x7fc5500b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38048/0 (socket says 172.21.15.5:38048) 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc547e00640 1 -- 172.21.15.5:0/3469170538 learned_addr learned my addr 172.21.15.5:0/3469170538 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc554a00640 1 --2- 172.21.15.5:0/3469170538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b4d20 0x7fc5500b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc547e00640 1 -- 172.21.15.5:0/3469170538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b4d20 msgr2=0x7fc5500b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc547e00640 1 --2- 172.21.15.5:0/3469170538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b4d20 0x7fc5500b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc547e00640 1 -- 172.21.15.5:0/3469170538 >> v1:172.21.15.112:6789/0 conn(0x7fc5500b6e60 legacy=0x7fc5500b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc547e00640 1 -- 172.21.15.5:0/3469170538 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5500b6070 con 0x7fc5500afb00 2024-04-26T21:37:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.603+0000 7fc554a00640 1 --2- 172.21.15.5:0/3469170538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b4d20 0x7fc5500b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.604+0000 7fc547e00640 1 --2- 172.21.15.5:0/3469170538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc5500b43e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc538009870 tx=0x7fc53802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb49fe56208ce7df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc54f400640 1 -- 172.21.15.5:0/3469170538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538037070 con 0x7fc5500afb00 2024-04-26T21:37:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc54f400640 1 -- 172.21.15.5:0/3469170538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc538032440 con 0x7fc5500afb00 2024-04-26T21:37:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc54f400640 1 -- 172.21.15.5:0/3469170538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538032810 con 0x7fc5500afb00 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc555400640 1 -- 172.21.15.5:0/3469170538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 msgr2=0x7fc5500b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc555400640 1 --2- 172.21.15.5:0/3469170538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc5500b43e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc538009870 tx=0x7fc53802a270 comp rx=0 tx=0).stop 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc555400640 1 -- 172.21.15.5:0/3469170538 shutdown_connections 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc555400640 1 --2- 172.21.15.5:0/3469170538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b4d20 0x7fc5500b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.605+0000 7fc555400640 1 --2- 172.21.15.5:0/3469170538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc5500b43e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.606+0000 7fc555400640 1 -- 172.21.15.5:0/3469170538 >> 172.21.15.5:0/3469170538 conn(0x7fc5500ba0f0 msgr2=0x7fc5500b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.606+0000 7fc555400640 1 -- 172.21.15.5:0/3469170538 shutdown_connections 2024-04-26T21:37:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.606+0000 7fc555400640 1 -- 172.21.15.5:0/3469170538 wait complete. 2024-04-26T21:37:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.607+0000 7fc555400640 1 Processor -- start 2024-04-26T21:37:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.607+0000 7fc555400640 1 -- start start 2024-04-26T21:37:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc555400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc550071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc555400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5500b4d20 0x7fc55014b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc555400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b6e60 0x7fc550149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc555400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc550074010 con 0x7fc5500afb00 2024-04-26T21:37:25.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc555400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc550073e90 con 0x7fc5500b4d20 2024-04-26T21:37:25.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc555400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc550152d70 con 0x7fc5500b6e60 2024-04-26T21:37:25.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc54fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc550071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc54fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc550071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38052/0 (socket says 172.21.15.5:38052) 2024-04-26T21:37:25.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.608+0000 7fc54fe00640 1 -- 172.21.15.5:0/1725177174 learned_addr learned my addr 172.21.15.5:0/1725177174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc554a00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b6e60 0x7fc550149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc547e00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5500b4d20 0x7fc55014b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54fe00640 1 -- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b6e60 msgr2=0x7fc550149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54fe00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b6e60 0x7fc550149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54fe00640 1 -- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5500b4d20 msgr2=0x7fc55014b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54fe00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5500b4d20 0x7fc55014b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54fe00640 1 -- 172.21.15.5:0/1725177174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55014bb20 con 0x7fc5500afb00 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc547e00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5500b4d20 0x7fc55014b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54fe00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc550071b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c450 tx=0x7fc54000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54cc00640 1 -- 172.21.15.5:0/1725177174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400052d0 con 0x7fc5500afb00 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54cc00640 1 -- 172.21.15.5:0/1725177174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc540005470 con 0x7fc5500afb00 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc54cc00640 1 -- 172.21.15.5:0/1725177174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540012870 con 0x7fc5500afb00 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.609+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc550148260 con 0x7fc5500afb00 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.610+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55014ac40 con 0x7fc5500afb00 2024-04-26T21:37:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.611+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55014be00 con 0x7fc5500afb00 2024-04-26T21:37:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.612+0000 7fc54cc00640 1 -- 172.21.15.5:0/1725177174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc540012a10 con 0x7fc5500afb00 2024-04-26T21:37:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.612+0000 7fc54cc00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc52c06c8f0 0x7fc52c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:25.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.613+0000 7fc54cc00640 1 -- 172.21.15.5:0/1725177174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc54008bad0 con 0x7fc5500afb00 2024-04-26T21:37:25.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.613+0000 7fc547e00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc52c06c8f0 0x7fc52c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:25.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.614+0000 7fc547e00640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc52c06c8f0 0x7fc52c06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc538034000 tx=0x7fc53802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.618+0000 7fc54cc00640 1 -- 172.21.15.5:0/1725177174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc55014be00 con 0x7fc5500afb00 2024-04-26T21:37:25.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.862+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc5500b8ef0 con 0x7fc5500afb00 2024-04-26T21:37:25.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.863+0000 7fc54cc00640 1 -- 172.21.15.5:0/1725177174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fc55014bb20 con 0x7fc5500afb00 2024-04-26T21:37:25.863 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.865+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc52c06c8f0 msgr2=0x7fc52c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.865+0000 7fc555400640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc52c06c8f0 0x7fc52c06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc538034000 tx=0x7fc53802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.865+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 msgr2=0x7fc550071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.865+0000 7fc555400640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc550071b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c450 tx=0x7fc54000c910 comp rx=0 tx=0).stop 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 shutdown_connections 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5500b6e60 0x7fc550149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5500b4d20 0x7fc55014b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc52c06c8f0 0x7fc52c06edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 --2- 172.21.15.5:0/1725177174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5500afb00 0x7fc550071b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:25.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 >> 172.21.15.5:0/1725177174 conn(0x7fc5500ba0f0 msgr2=0x7fc550075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:25.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 shutdown_connections 2024-04-26T21:37:25.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:25.866+0000 7fc555400640 1 -- 172.21.15.5:0/1725177174 wait complete. 2024-04-26T21:37:25.886 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T21:37:25.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:37:25.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-26T21:37:25.886 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T21:37:25.887 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:25.887 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T21:37:25.887 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:37:25.887 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:37:25.887 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T21:37:25.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:25.887 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-26T21:37:25.939 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42649sec preferred_lft 42649sec 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-26T21:37:25.941 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-04-26T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-04-26T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:26.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:26.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:26.444 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:37:26.523 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-26T21:37:26.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:26.526 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-26T21:37:26.581 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-26T21:37:26.581 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:37:26.582 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T21:37:26.582 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T21:37:26.582 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:37:26.582 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:26.582 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:26.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T21:37:26.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T21:37:26.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T21:37:26.583 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:27.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:27.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:27.365 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-26T21:37:27.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:27.417 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-04-26T21:37:27.468 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:27.469 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:27.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:27.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T21:37:27.469 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:27.660 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T21:37:27.660 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:27.660 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:27.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T21:37:27.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:37:27.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T21:37:27.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T21:37:27.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T21:37:27.661 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:27.978 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:27.978 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:27.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-26T21:37:27.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:37:27.979 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:28.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:28.189 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T21:37:28.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:37:28.189 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T21:37:28.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:37:28.236 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:28.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-04-26T21:37:28.404 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:37:28.456 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:37:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:37:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:37:28.459 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-04-26T21:37:28.459 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:28.459 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:28.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:28.460 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-04-26T21:37:28.505 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:37:28.505 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T21:37:28.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-04-26T21:37:28.629 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:37:28.674 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-04-26T21:37:28.674 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-04-26T21:37:28.674 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-04-26T21:37:28.674 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-04-26T21:37:28.674 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-04-26T21:37:28.675 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:28.676 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:28.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:28.677 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-04-26T21:37:29.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:2024-04-26T21:37:29.445+0000 7f6af3a0c480 -1 init, newargv = 0x56261b2a05b0 newargc=15 2024-04-26T21:37:29.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[38336]: starting ceph client 2024-04-26T21:37:29.460 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[38336]: starting fuse 2024-04-26T21:37:29.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-04-26T21:37:29.972 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-04-26T21:37:30.032 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:37:30.033 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:30.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:30.035 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-04-26T21:37:30.094 INFO:teuthology.orchestra.run.smithi005.stdout:40 2024-04-26T21:37:30.094 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-04-26T21:37:30.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:30.095 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.admin")) 2024-04-26T21:37:30.096 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-26T21:37:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.admin.38336.asok 2024-04-26T21:37:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:30.294 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.38336.asok 2024-04-26T21:37:30.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:30.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.38336.asok status 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "admin", 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "38336", 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-04-26T21:37:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4389, 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4389 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2281284045 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-04-26T21:37:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2281284045 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4389 192.168.0.1:0/2281284045", 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/2281284045", 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 7, 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 24, 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-04-26T21:37:30.534 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T21:37:30.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:30.547 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-04-26T21:37:30.547 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:30.601 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-04-26T21:37:30.602 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:30.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:30.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:30.694 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T21:37:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:37:30.860 INFO:teuthology.orchestra.run.smithi005.stdout:# file: . 2024-04-26T21:37:30.860 INFO:teuthology.orchestra.run.smithi005.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T21:37:30.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:30.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:30.871 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:37:30.871 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:37:30.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.139+0000 7ff259c00640 1 Processor -- start 2024-04-26T21:37:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.139+0000 7ff259c00640 1 -- start start 2024-04-26T21:37:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.140+0000 7ff259c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2540b8b20 0x7ff2540b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.140+0000 7ff259c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2540b8f00 con 0x7ff254150e10 2024-04-26T21:37:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.140+0000 7ff259c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25406e4c0 con 0x7ff2540b6600 2024-04-26T21:37:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.140+0000 7ff259c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff25406eb10 con 0x7ff2540b8b20 2024-04-26T21:37:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.141+0000 7ff259200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff254150e10 0x7ff254153200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37392/0 (socket says 172.21.15.5:37392) 2024-04-26T21:37:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.141+0000 7ff259200640 1 -- 172.21.15.5:0/3167043595 learned_addr learned my addr 172.21.15.5:0/3167043595 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.141+0000 7ff253e00640 1 --2- 172.21.15.5:0/3167043595 >> v2:172.21.15.112:3300/0 conn(0x7ff2540b8b20 0x7ff2540b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.141+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620249408 0 0) 0x7ff2540b8f00 con 0x7ff254150e10 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.141+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff238003520 con 0x7ff254150e10 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.141+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1323568450 0 0) 0x7ff238003520 con 0x7ff254150e10 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 >> v2:172.21.15.112:3300/0 conn(0x7ff2540b8b20 msgr2=0x7ff2540b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 --2- 172.21.15.5:0/3167043595 >> v2:172.21.15.112:3300/0 conn(0x7ff2540b8b20 0x7ff2540b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 >> v1:172.21.15.112:6789/0 conn(0x7ff2540b6600 legacy=0x7ff254142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25406e7a0 con 0x7ff254150e10 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7ff24c0019f0 con 0x7ff254150e10 2024-04-26T21:37:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 >> v1:172.21.15.5:6789/0 conn(0x7ff254150e10 legacy=0x7ff254153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2380039b0 0x7ff238003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238004800 0x7ff238004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2380051c0 0x7ff23800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff25406eb10 con 0x7ff238004800 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff23800c060 con 0x7ff2380039b0 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff23800c260 con 0x7ff2380051c0 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff253400640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238004800 0x7ff238004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff253e00640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2380039b0 0x7ff238003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff259200640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2380051c0 0x7ff23800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff253400640 1 -- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2380051c0 msgr2=0x7ff23800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff253400640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2380051c0 0x7ff23800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff253400640 1 -- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2380039b0 msgr2=0x7ff238003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff253400640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2380039b0 0x7ff238003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.142+0000 7ff253400640 1 -- 172.21.15.5:0/3167043595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff238003520 con 0x7ff238004800 2024-04-26T21:37:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.143+0000 7ff259200640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2380051c0 0x7ff23800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.143+0000 7ff259200640 1 -- 172.21.15.5:0/3167043595 reap_dead start 2024-04-26T21:37:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff253400640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238004800 0x7ff238004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff240001750 tx=0x7ff238005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ff9c9ba70784cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240001370 con 0x7ff238004800 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2400052d0 con 0x7ff238004800 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff252a00640 1 -- 172.21.15.5:0/3167043595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24002abc0 con 0x7ff238004800 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff259c00640 1 -- 172.21.15.5:0/3167043595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238004800 msgr2=0x7ff238004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff259c00640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238004800 0x7ff238004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff240001750 tx=0x7ff238005830 comp rx=0 tx=0).stop 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff259c00640 1 -- 172.21.15.5:0/3167043595 shutdown_connections 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff259c00640 1 --2- 172.21.15.5:0/3167043595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238004800 0x7ff238004c80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.144+0000 7ff259c00640 1 -- 172.21.15.5:0/3167043595 >> 172.21.15.5:0/3167043595 conn(0x7ff254068270 msgr2=0x7ff254068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.145+0000 7ff259c00640 1 -- 172.21.15.5:0/3167043595 shutdown_connections 2024-04-26T21:37:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.145+0000 7ff259c00640 1 -- 172.21.15.5:0/3167043595 wait complete. 2024-04-26T21:37:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.146+0000 7ff259c00640 1 Processor -- start 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.146+0000 7ff259c00640 1 -- start start 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.147+0000 7ff259c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238004800 0x7ff254144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.147+0000 7ff259c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254142ea0 0x7ff254143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.147+0000 7ff259c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541441b0 0x7ff254137d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.147+0000 7ff259c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff254073ea0 con 0x7ff2541441b0 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.147+0000 7ff259c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff25406f390 con 0x7ff238004800 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.147+0000 7ff259c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff254074020 con 0x7ff254142ea0 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541441b0 0x7ff254137d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541441b0 0x7ff254137d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38080/0 (socket says 172.21.15.5:38080) 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 -- 172.21.15.5:0/2063406975 learned_addr learned my addr 172.21.15.5:0/2063406975 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff253400640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254142ea0 0x7ff254143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff253e00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238004800 0x7ff254144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 -- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254142ea0 msgr2=0x7ff254143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254142ea0 0x7ff254143c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 -- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238004800 msgr2=0x7ff254144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238004800 0x7ff254144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 -- 172.21.15.5:0/2063406975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2541450a0 con 0x7ff2541441b0 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.148+0000 7ff259200640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541441b0 0x7ff254137d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff254146170 tx=0x7ff24c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.149+0000 7ff24be00640 1 -- 172.21.15.5:0/2063406975 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c004d60 con 0x7ff2541441b0 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.149+0000 7ff24be00640 1 -- 172.21.15.5:0/2063406975 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c00bb20 con 0x7ff2541441b0 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.149+0000 7ff24be00640 1 -- 172.21.15.5:0/2063406975 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c007110 con 0x7ff2541441b0 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.149+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff254145bc0 con 0x7ff2541441b0 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.149+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25413be30 con 0x7ff2541441b0 2024-04-26T21:37:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.150+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff254075db0 con 0x7ff2541441b0 2024-04-26T21:37:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.151+0000 7ff24be00640 1 -- 172.21.15.5:0/2063406975 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff24c01b020 con 0x7ff2541441b0 2024-04-26T21:37:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.152+0000 7ff24be00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c8f0 0x7ff23406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.152+0000 7ff24be00640 1 -- 172.21.15.5:0/2063406975 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff24c08bf90 con 0x7ff2541441b0 2024-04-26T21:37:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.153+0000 7ff253e00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c8f0 0x7ff23406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.154+0000 7ff253e00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c8f0 0x7ff23406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff244009a90 tx=0x7ff244008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.157+0000 7ff24be00640 1 -- 172.21.15.5:0/2063406975 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff2541450a0 con 0x7ff2541441b0 2024-04-26T21:37:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.360+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff254145f20 con 0x7ff2541441b0 2024-04-26T21:37:31.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.362+0000 7ff24be00640 1 -- 172.21.15.5:0/2063406975 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7ff24c059a20 con 0x7ff2541441b0 2024-04-26T21:37:31.363 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:31.363 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c8f0 msgr2=0x7ff23406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c8f0 0x7ff23406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff244009a90 tx=0x7ff244008040 comp rx=0 tx=0).stop 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541441b0 msgr2=0x7ff254137d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541441b0 0x7ff254137d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff254146170 tx=0x7ff24c00b4a0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 shutdown_connections 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c8f0 0x7ff23406edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541441b0 0x7ff254137d30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254142ea0 0x7ff254143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 --2- 172.21.15.5:0/2063406975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238004800 0x7ff254144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 >> 172.21.15.5:0/2063406975 conn(0x7ff254068270 msgr2=0x7ff254072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 shutdown_connections 2024-04-26T21:37:31.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.365+0000 7ff259c00640 1 -- 172.21.15.5:0/2063406975 wait complete. 2024-04-26T21:37:31.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:37:14.651248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:37:15.859697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:37:19.462053+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:37:31.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:37:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.590+0000 7fa8bb600640 1 Processor -- start 2024-04-26T21:37:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.590+0000 7fa8bb600640 1 -- start start 2024-04-26T21:37:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.591+0000 7fa8bb600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8b406dc30 0x7fa8b40b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.591+0000 7fa8bb600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa8b414c2c0 0x7fa8b4152f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.591+0000 7fa8bb600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b406e010 con 0x7fa8b406d150 2024-04-26T21:37:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.591+0000 7fa8bb600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b4073bc0 con 0x7fa8b406dc30 2024-04-26T21:37:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.591+0000 7fa8bb600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b4073ea0 con 0x7fa8b414c2c0 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8b406dc30 0x7fa8b40b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8b406dc30 0x7fa8b40b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38094/0 (socket says 172.21.15.5:38094) 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b8c00640 1 -- 172.21.15.5:0/664547712 learned_addr learned my addr 172.21.15.5:0/664547712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b8c00640 1 -- 172.21.15.5:0/664547712 >> v2:172.21.15.112:3300/0 conn(0x7fa8b414c2c0 msgr2=0x7fa8b4152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b9600640 1 --2- 172.21.15.5:0/664547712 >> v2:172.21.15.112:3300/0 conn(0x7fa8b414c2c0 0x7fa8b4152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b8c00640 1 --2- 172.21.15.5:0/664547712 >> v2:172.21.15.112:3300/0 conn(0x7fa8b414c2c0 0x7fa8b4152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b8c00640 1 -- 172.21.15.5:0/664547712 >> v1:172.21.15.112:6789/0 conn(0x7fa8b406d150 legacy=0x7fa8b414bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b8c00640 1 -- 172.21.15.5:0/664547712 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b406eae0 con 0x7fa8b406dc30 2024-04-26T21:37:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.592+0000 7fa8b9600640 1 --2- 172.21.15.5:0/664547712 >> v2:172.21.15.112:3300/0 conn(0x7fa8b414c2c0 0x7fa8b4152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.593+0000 7fa8b8c00640 1 --2- 172.21.15.5:0/664547712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b40b3ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b1060 tx=0x7fa8a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabd39ed2f59c1d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.594+0000 7fa8b3400640 1 -- 172.21.15.5:0/664547712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4037070 con 0x7fa8b406dc30 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.594+0000 7fa8b3400640 1 -- 172.21.15.5:0/664547712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a4032440 con 0x7fa8b406dc30 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.594+0000 7fa8b3400640 1 -- 172.21.15.5:0/664547712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4032810 con 0x7fa8b406dc30 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 -- 172.21.15.5:0/664547712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 msgr2=0x7fa8b40b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 --2- 172.21.15.5:0/664547712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b40b3ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b1060 tx=0x7fa8a402a1a0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 -- 172.21.15.5:0/664547712 shutdown_connections 2024-04-26T21:37:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 --2- 172.21.15.5:0/664547712 >> v2:172.21.15.112:3300/0 conn(0x7fa8b414c2c0 0x7fa8b4152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 --2- 172.21.15.5:0/664547712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b40b3ac0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 -- 172.21.15.5:0/664547712 >> 172.21.15.5:0/664547712 conn(0x7fa8b40b7bb0 msgr2=0x7fa8b40b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 -- 172.21.15.5:0/664547712 shutdown_connections 2024-04-26T21:37:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.595+0000 7fa8bb600640 1 -- 172.21.15.5:0/664547712 wait complete. 2024-04-26T21:37:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.597+0000 7fa8bb600640 1 Processor -- start 2024-04-26T21:37:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.597+0000 7fa8bb600640 1 -- start start 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.598+0000 7fa8bb600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8b406d150 0x7fa8b413aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.598+0000 7fa8bb600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b4140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.598+0000 7fa8bb600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8b414c2c0 0x7fa8b41410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8bb600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40b4180 con 0x7fa8b406dc30 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8bb600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40b4000 con 0x7fa8b414c2c0 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8bb600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b4153480 con 0x7fa8b406d150 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b4140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b4140bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38110/0 (socket says 172.21.15.5:38110) 2024-04-26T21:37:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8b3e00640 1 -- 172.21.15.5:0/3759159173 learned_addr learned my addr 172.21.15.5:0/3759159173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8b9600640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8b414c2c0 0x7fa8b41410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.599+0000 7fa8b8c00640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8b406d150 0x7fa8b413aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b3e00640 1 -- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8b406d150 msgr2=0x7fa8b413aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b3e00640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8b406d150 0x7fa8b413aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b3e00640 1 -- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8b414c2c0 msgr2=0x7fa8b41410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b3e00640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8b414c2c0 0x7fa8b41410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b3e00640 1 -- 172.21.15.5:0/3759159173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b40704c0 con 0x7fa8b406dc30 2024-04-26T21:37:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b3e00640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b4140bb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c430 tx=0x7fa8a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b0c00640 1 -- 172.21.15.5:0/3759159173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0011790 con 0x7fa8b406dc30 2024-04-26T21:37:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b0c00640 1 -- 172.21.15.5:0/3759159173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a0017070 con 0x7fa8b406dc30 2024-04-26T21:37:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8b0c00640 1 -- 172.21.15.5:0/3759159173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0011bb0 con 0x7fa8b406dc30 2024-04-26T21:37:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.600+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b40707a0 con 0x7fa8b406dc30 2024-04-26T21:37:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.601+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b413bab0 con 0x7fa8b406dc30 2024-04-26T21:37:31.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.602+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b414b820 con 0x7fa8b406dc30 2024-04-26T21:37:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.603+0000 7fa8b0c00640 1 -- 172.21.15.5:0/3759159173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8a001c460 con 0x7fa8b406dc30 2024-04-26T21:37:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.604+0000 7fa8b0c00640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa89406c8f0 0x7fa89406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:31.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.605+0000 7fa8b0c00640 1 -- 172.21.15.5:0/3759159173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa8a008bcc0 con 0x7fa8b406dc30 2024-04-26T21:37:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.605+0000 7fa8b8c00640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa89406c8f0 0x7fa89406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:31.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.606+0000 7fa8b8c00640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa89406c8f0 0x7fa89406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4034000 tx=0x7fa8a402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:31.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.610+0000 7fa8b0c00640 1 -- 172.21.15.5:0/3759159173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa8a0059da0 con 0x7fa8b406dc30 2024-04-26T21:37:31.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.814+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8b4075db0 con 0x7fa8b406dc30 2024-04-26T21:37:31.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.814+0000 7fa8b0c00640 1 -- 172.21.15.5:0/3759159173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fa8a00596a0 con 0x7fa8b406dc30 2024-04-26T21:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa89406c8f0 msgr2=0x7fa89406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa89406c8f0 0x7fa89406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4034000 tx=0x7fa8a402e000 comp rx=0 tx=0).stop 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 msgr2=0x7fa8b4140bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b4140bb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c430 tx=0x7fa8a000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 shutdown_connections 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8b414c2c0 0x7fa8b41410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa89406c8f0 0x7fa89406edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b406dc30 0x7fa8b4140bb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 --2- 172.21.15.5:0/3759159173 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8b406d150 0x7fa8b413aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 >> 172.21.15.5:0/3759159173 conn(0x7fa8b40b7bb0 msgr2=0x7fa8b40b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 shutdown_connections 2024-04-26T21:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:31.817+0000 7fa8bb600640 1 -- 172.21.15.5:0/3759159173 wait complete. 2024-04-26T21:37:31.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:37:32.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.040+0000 7f6462600640 1 Processor -- start 2024-04-26T21:37:32.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.040+0000 7f6462600640 1 -- start start 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f6462600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c0b6d50 0x7f645c146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f6462600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f645c073d00 0x7f645c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f6462600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f645c0b3bb0 con 0x7f645c1469c0 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f6462600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f645c070c20 con 0x7f645c073d00 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f6462600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f645c0b6260 con 0x7f645c0b6d50 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f645be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f645c1469c0 0x7f645c0735f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37400/0 (socket says 172.21.15.5:37400) 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f6461c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f645c073d00 0x7f645c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f645be00640 1 -- 172.21.15.5:0/1678844770 learned_addr learned my addr 172.21.15.5:0/1678844770 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.042+0000 7f6461200640 1 --2- 172.21.15.5:0/1678844770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c0b6d50 0x7f645c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.043+0000 7f645b400640 1 -- 172.21.15.5:0/1678844770 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861241346 0 0) 0x7f645c0b3bb0 con 0x7f645c1469c0 2024-04-26T21:37:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.043+0000 7f645b400640 1 -- 172.21.15.5:0/1678844770 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6444003520 con 0x7f645c1469c0 2024-04-26T21:37:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.043+0000 7f6461c00640 1 -- 172.21.15.5:0/1678844770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c0b6d50 msgr2=0x7f645c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:32.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.043+0000 7f6461c00640 1 --2- 172.21.15.5:0/1678844770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c0b6d50 0x7f645c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.043+0000 7f6461c00640 1 -- 172.21.15.5:0/1678844770 >> v1:172.21.15.5:6789/0 conn(0x7f645c1469c0 legacy=0x7f645c0735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.043+0000 7f6461c00640 1 -- 172.21.15.5:0/1678844770 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c0b7130 con 0x7f645c073d00 2024-04-26T21:37:32.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.043+0000 7f6461200640 1 --2- 172.21.15.5:0/1678844770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c0b6d50 0x7f645c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:32.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.044+0000 7f6461c00640 1 --2- 172.21.15.5:0/1678844770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c073d00 0x7f645c150d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6454009d90 tx=0x7f645402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7869594eb754583 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.044+0000 7f645b400640 1 -- 172.21.15.5:0/1678844770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454007740 con 0x7f645c073d00 2024-04-26T21:37:32.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f645b400640 1 -- 172.21.15.5:0/1678844770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64540078e0 con 0x7f645c073d00 2024-04-26T21:37:32.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f645b400640 1 -- 172.21.15.5:0/1678844770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454007c90 con 0x7f645c073d00 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 -- 172.21.15.5:0/1678844770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c073d00 msgr2=0x7f645c150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 --2- 172.21.15.5:0/1678844770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c073d00 0x7f645c150d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6454009d90 tx=0x7f645402a530 comp rx=0 tx=0).stop 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 -- 172.21.15.5:0/1678844770 shutdown_connections 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 --2- 172.21.15.5:0/1678844770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c073d00 0x7f645c150d20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 --2- 172.21.15.5:0/1678844770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c0b6d50 0x7f645c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 -- 172.21.15.5:0/1678844770 >> 172.21.15.5:0/1678844770 conn(0x7f645c06c720 msgr2=0x7f645c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 -- 172.21.15.5:0/1678844770 shutdown_connections 2024-04-26T21:37:32.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.045+0000 7f6462600640 1 -- 172.21.15.5:0/1678844770 wait complete. 2024-04-26T21:37:32.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.047+0000 7f6462600640 1 Processor -- start 2024-04-26T21:37:32.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.047+0000 7f6462600640 1 -- start start 2024-04-26T21:37:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.048+0000 7f6462600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c073d00 0x7f645c1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.048+0000 7f6462600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c0b6d50 0x7f645c149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.048+0000 7f6462600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f645c1469c0 0x7f645c0b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.048+0000 7f6462600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f645c0b5c40 con 0x7f645c0b6d50 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.048+0000 7f6462600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f645c070700 con 0x7f645c1469c0 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.048+0000 7f6462600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f645c0b0cd0 con 0x7f645c073d00 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c0b6d50 0x7f645c149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c0b6d50 0x7f645c149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38134/0 (socket says 172.21.15.5:38134) 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 -- 172.21.15.5:0/1804070547 learned_addr learned my addr 172.21.15.5:0/1804070547 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f6461200640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c073d00 0x7f645c1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f6461c00640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f645c1469c0 0x7f645c0b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 -- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c073d00 msgr2=0x7f645c1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c073d00 0x7f645c1495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 -- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f645c1469c0 msgr2=0x7f645c0b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f645c1469c0 0x7f645c0b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 -- 172.21.15.5:0/1804070547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c144010 con 0x7f645c0b6d50 2024-04-26T21:37:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.049+0000 7f645be00640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c0b6d50 0x7f645c149d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f644800c3c0 tx=0x7f644800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.050+0000 7f6458c00640 1 -- 172.21.15.5:0/1804070547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448017070 con 0x7f645c0b6d50 2024-04-26T21:37:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.050+0000 7f6458c00640 1 -- 172.21.15.5:0/1804070547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6448005ce0 con 0x7f645c0b6d50 2024-04-26T21:37:32.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.050+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c14a290 con 0x7f645c0b6d50 2024-04-26T21:37:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.050+0000 7f6458c00640 1 -- 172.21.15.5:0/1804070547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64480072f0 con 0x7f645c0b6d50 2024-04-26T21:37:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.050+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c148760 con 0x7f645c0b6d50 2024-04-26T21:37:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.051+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645c075db0 con 0x7f645c0b6d50 2024-04-26T21:37:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.052+0000 7f6458c00640 1 -- 172.21.15.5:0/1804070547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f644801a070 con 0x7f645c0b6d50 2024-04-26T21:37:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.053+0000 7f6458c00640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f643c06c8f0 0x7f643c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.053+0000 7f6458c00640 1 -- 172.21.15.5:0/1804070547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f644808b220 con 0x7f645c0b6d50 2024-04-26T21:37:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.054+0000 7f6461200640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f643c06c8f0 0x7f643c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.055+0000 7f6461200640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f643c06c8f0 0x7f643c06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6450006fd0 tx=0x7f6450008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.058+0000 7f6458c00640 1 -- 172.21.15.5:0/1804070547 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6448059300 con 0x7f645c0b6d50 2024-04-26T21:37:32.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.260+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f645c068a50 con 0x7f645c0b6d50 2024-04-26T21:37:32.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.261+0000 7f6458c00640 1 -- 172.21.15.5:0/1804070547 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f6448058c00 con 0x7f645c0b6d50 2024-04-26T21:37:32.262 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:32.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f643c06c8f0 msgr2=0x7f643c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f643c06c8f0 0x7f643c06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6450006fd0 tx=0x7f6450008040 comp rx=0 tx=0).stop 2024-04-26T21:37:32.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c0b6d50 msgr2=0x7f645c149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c0b6d50 0x7f645c149d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f644800c3c0 tx=0x7f644800c880 comp rx=0 tx=0).stop 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 shutdown_connections 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f645c1469c0 0x7f645c0b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f643c06c8f0 0x7f643c06edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f645c0b6d50 0x7f645c149d50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 --2- 172.21.15.5:0/1804070547 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f645c073d00 0x7f645c1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.264+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 >> 172.21.15.5:0/1804070547 conn(0x7f645c06c720 msgr2=0x7f645c1444d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.265+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 shutdown_connections 2024-04-26T21:37:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.265+0000 7f6462600640 1 -- 172.21.15.5:0/1804070547 wait complete. 2024-04-26T21:37:32.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:37:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.491+0000 7f2d71800640 1 Processor -- start 2024-04-26T21:37:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.492+0000 7f2d71800640 1 -- start start 2024-04-26T21:37:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.493+0000 7f2d71800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d6c0b6ce0 0x7f2d6c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.493+0000 7f2d71800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c149200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.493+0000 7f2d71800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d6c13eff0 0x7f2d6c13f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.493+0000 7f2d71800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6c0b37d0 con 0x7f2d6c13eff0 2024-04-26T21:37:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.493+0000 7f2d71800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6c149740 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.493+0000 7f2d71800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c13f9c0 con 0x7f2d6c0b1050 2024-04-26T21:37:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.493+0000 7f2d70e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d6c13eff0 0x7f2d6c13f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d70e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d6c13eff0 0x7f2d6c13f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38136/0 (socket says 172.21.15.5:38136) 2024-04-26T21:37:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d70e00640 1 -- 172.21.15.5:0/2214681498 learned_addr learned my addr 172.21.15.5:0/2214681498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d6be00640 1 --2- 172.21.15.5:0/2214681498 >> v2:172.21.15.112:3300/0 conn(0x7f2d6c0b6ce0 0x7f2d6c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d70e00640 1 -- 172.21.15.5:0/2214681498 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 msgr2=0x7f2d6c149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d63e00640 1 --2- 172.21.15.5:0/2214681498 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d70e00640 1 --2- 172.21.15.5:0/2214681498 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d70e00640 1 -- 172.21.15.5:0/2214681498 >> v2:172.21.15.112:3300/0 conn(0x7f2d6c0b6ce0 msgr2=0x7f2d6c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d70e00640 1 --2- 172.21.15.5:0/2214681498 >> v2:172.21.15.112:3300/0 conn(0x7f2d6c0b6ce0 0x7f2d6c0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.494+0000 7f2d70e00640 1 -- 172.21.15.5:0/2214681498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c0b70c0 con 0x7f2d6c13eff0 2024-04-26T21:37:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.495+0000 7f2d70e00640 1 --2- 172.21.15.5:0/2214681498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c13eff0 0x7f2d6c13f480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c06ecc0 tx=0x7f2d6402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bc049f6cb9028d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.495+0000 7f2d6b400640 1 -- 172.21.15.5:0/2214681498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64036070 con 0x7f2d6c13eff0 2024-04-26T21:37:32.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.495+0000 7f2d6b400640 1 -- 172.21.15.5:0/2214681498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d64031600 con 0x7f2d6c13eff0 2024-04-26T21:37:32.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.495+0000 7f2d6b400640 1 -- 172.21.15.5:0/2214681498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640319d0 con 0x7f2d6c13eff0 2024-04-26T21:37:32.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 -- 172.21.15.5:0/2214681498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c13eff0 msgr2=0x7f2d6c13f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 --2- 172.21.15.5:0/2214681498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c13eff0 0x7f2d6c13f480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c06ecc0 tx=0x7f2d6402a610 comp rx=0 tx=0).stop 2024-04-26T21:37:32.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 -- 172.21.15.5:0/2214681498 shutdown_connections 2024-04-26T21:37:32.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 --2- 172.21.15.5:0/2214681498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c13eff0 0x7f2d6c13f480 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 --2- 172.21.15.5:0/2214681498 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 --2- 172.21.15.5:0/2214681498 >> v2:172.21.15.112:3300/0 conn(0x7f2d6c0b6ce0 0x7f2d6c0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 -- 172.21.15.5:0/2214681498 >> 172.21.15.5:0/2214681498 conn(0x7f2d6c06c720 msgr2=0x7f2d6c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 -- 172.21.15.5:0/2214681498 shutdown_connections 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.496+0000 7f2d71800640 1 -- 172.21.15.5:0/2214681498 wait complete. 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.498+0000 7f2d71800640 1 Processor -- start 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.498+0000 7f2d71800640 1 -- start start 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d71800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c1dc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d71800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c0b6ce0 0x7f2d6c1dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d71800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d6c13eff0 0x7f2d6c13fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d71800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0b6320 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d71800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c070ba0 con 0x7f2d6c13eff0 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d71800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c0b64a0 con 0x7f2d6c0b1050 2024-04-26T21:37:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d63e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c0b6ce0 0x7f2d6c1dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d63e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c0b6ce0 0x7f2d6c1dc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38152/0 (socket says 172.21.15.5:38152) 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d63e00640 1 -- 172.21.15.5:0/1264551909 learned_addr learned my addr 172.21.15.5:0/1264551909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.499+0000 7f2d6be00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c1dc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d70e00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d6c13eff0 0x7f2d6c13fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d63e00640 1 -- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 msgr2=0x7f2d6c1dc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d63e00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c1dc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d63e00640 1 -- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d6c13eff0 msgr2=0x7f2d6c13fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d63e00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d6c13eff0 0x7f2d6c13fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d63e00640 1 -- 172.21.15.5:0/1264551909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c073640 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d63e00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c0b6ce0 0x7f2d6c1dc7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c570 tx=0x7f2d5400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d68c00640 1 -- 172.21.15.5:0/1264551909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54015070 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d68c00640 1 -- 172.21.15.5:0/1264551909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d54011800 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c1dce10 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d68c00640 1 -- 172.21.15.5:0/1264551909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011bf0 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.500+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c1dd0f0 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.502+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c0b6080 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.503+0000 7f2d68c00640 1 -- 172.21.15.5:0/1264551909 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d54018070 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.503+0000 7f2d68c00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2d4806c8f0 0x7f2d4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.504+0000 7f2d68c00640 1 -- 172.21.15.5:0/1264551909 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2d5408bc60 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.504+0000 7f2d6be00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2d4806c8f0 0x7f2d4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.505+0000 7f2d6be00640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2d4806c8f0 0x7f2d4806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.509+0000 7f2d68c00640 1 -- 172.21.15.5:0/1264551909 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2d6c0b6080 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.717+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2d6c075db0 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.720+0000 7f2d68c00640 1 -- 172.21.15.5:0/1264551909 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f2d54059de0 con 0x7f2d6c0b6ce0 2024-04-26T21:37:32.720 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-26T21:37:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2d4806c8f0 msgr2=0x7f2d4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2d4806c8f0 0x7f2d4806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c008040 comp rx=0 tx=0).stop 2024-04-26T21:37:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c0b6ce0 msgr2=0x7f2d6c1dc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c0b6ce0 0x7f2d6c1dc7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c570 tx=0x7f2d5400ca30 comp rx=0 tx=0).stop 2024-04-26T21:37:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 shutdown_connections 2024-04-26T21:37:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d6c13eff0 0x7f2d6c13fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2d4806c8f0 0x7f2d4806edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d6c0b6ce0 0x7f2d6c1dc7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 --2- 172.21.15.5:0/1264551909 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d6c0b1050 0x7f2d6c1dc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 >> 172.21.15.5:0/1264551909 conn(0x7f2d6c06c720 msgr2=0x7f2d6c13c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 shutdown_connections 2024-04-26T21:37:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.723+0000 7f2d71800640 1 -- 172.21.15.5:0/1264551909 wait complete. 2024-04-26T21:37:32.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:37:32.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.956+0000 7fb8cd400640 1 Processor -- start 2024-04-26T21:37:32.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.956+0000 7fb8cd400640 1 -- start start 2024-04-26T21:37:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.957+0000 7fb8cd400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 0x7fb8c80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8cd400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8c80b7b00 0x7fb8c80b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8cd400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8c80bede0 con 0x7fb8c80bea00 2024-04-26T21:37:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8cd400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb8c8143150 con 0x7fb8c80b7b00 2024-04-26T21:37:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8cd400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c80b8050 con 0x7fb8c814cb70 2024-04-26T21:37:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8c6800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb8c80bea00 0x7fb8c8148980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37402/0 (socket says 172.21.15.5:37402) 2024-04-26T21:37:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8c6800640 1 -- 172.21.15.5:0/404239599 learned_addr learned my addr 172.21.15.5:0/404239599 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8c7200640 1 --2- 172.21.15.5:0/404239599 >> v2:172.21.15.112:3300/0 conn(0x7fb8c80b7b00 0x7fb8c80b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8c5e00640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 0x7fb8c80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.958+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636655978 0 0) 0x7fb8c80bede0 con 0x7fb8c80bea00 2024-04-26T21:37:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8ac003520 con 0x7fb8c80bea00 2024-04-26T21:37:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3988302747 0 0) 0x7fb8ac003520 con 0x7fb8c80bea00 2024-04-26T21:37:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 msgr2=0x7fb8c80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 0x7fb8c80b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 >> v2:172.21.15.112:3300/0 conn(0x7fb8c80b7b00 msgr2=0x7fb8c80b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 --2- 172.21.15.5:0/404239599 >> v2:172.21.15.112:3300/0 conn(0x7fb8c80b7b00 0x7fb8c80b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c814c090 con 0x7fb8c80bea00 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fb8b80019f0 con 0x7fb8c80bea00 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 >> v1:172.21.15.5:6789/0 conn(0x7fb8c80bea00 legacy=0x7fb8c8148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8ac0039b0 0x7fb8ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 0x7fb8ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8143150 con 0x7fb8ac004d40 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c80b8050 con 0x7fb8ac0039b0 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ac00b9c0 con 0x7fb8c814cb70 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.959+0000 7fb8c7200640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.960+0000 7fb8c5e00640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 0x7fb8ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.960+0000 7fb8c6800640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8ac0039b0 0x7fb8ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.960+0000 7fb8c7200640 1 -- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 msgr2=0x7fb8ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.960+0000 7fb8c7200640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c814cb70 0x7fb8ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.960+0000 7fb8c7200640 1 -- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8ac0039b0 msgr2=0x7fb8ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.960+0000 7fb8c7200640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8ac0039b0 0x7fb8ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.960+0000 7fb8c7200640 1 -- 172.21.15.5:0/404239599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac003520 con 0x7fb8ac004d40 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.961+0000 7fb8c7200640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8ac0051c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009a90 tx=0x7fb8ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4822e673b605087a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.961+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0036070 con 0x7fb8ac004d40 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.961+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c0031400 con 0x7fb8ac004d40 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.961+0000 7fb8c5400640 1 -- 172.21.15.5:0/404239599 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0009690 con 0x7fb8ac004d40 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.962+0000 7fb8cd400640 1 -- 172.21.15.5:0/404239599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 msgr2=0x7fb8ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.962+0000 7fb8cd400640 1 --2- 172.21.15.5:0/404239599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8ac0051c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009a90 tx=0x7fb8ac005830 comp rx=0 tx=0).stop 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.962+0000 7fb8c7200640 1 -- 172.21.15.5:0/404239599 reap_dead start 2024-04-26T21:37:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.962+0000 7fb8cd400640 1 -- 172.21.15.5:0/404239599 shutdown_connections 2024-04-26T21:37:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.962+0000 7fb8cd400640 1 -- 172.21.15.5:0/404239599 >> 172.21.15.5:0/404239599 conn(0x7fb8c8068720 msgr2=0x7fb8c80be080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.962+0000 7fb8cd400640 1 -- 172.21.15.5:0/404239599 shutdown_connections 2024-04-26T21:37:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.962+0000 7fb8cd400640 1 -- 172.21.15.5:0/404239599 wait complete. 2024-04-26T21:37:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.964+0000 7fb8cd400640 1 Processor -- start 2024-04-26T21:37:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.964+0000 7fb8cd400640 1 -- start start 2024-04-26T21:37:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8cd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8c80aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8cd400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8c80b0880 0x7fb8c80b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8cd400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c81ddcc0 0x7fb8c81de140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8cd400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c80b55a0 con 0x7fb8ac004d40 2024-04-26T21:37:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8cd400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c814c650 con 0x7fb8c80b0880 2024-04-26T21:37:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8cd400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c80b5720 con 0x7fb8c81ddcc0 2024-04-26T21:37:32.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8c6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8c80aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8c6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8c80aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38180/0 (socket says 172.21.15.5:38180) 2024-04-26T21:37:32.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.965+0000 7fb8c6800640 1 -- 172.21.15.5:0/3582774588 learned_addr learned my addr 172.21.15.5:0/3582774588 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c7200640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c81ddcc0 0x7fb8c81de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c5e00640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8c80b0880 0x7fb8c80b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c6800640 1 -- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c81ddcc0 msgr2=0x7fb8c81de140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c6800640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c81ddcc0 0x7fb8c81de140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c6800640 1 -- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8c80b0880 msgr2=0x7fb8c80b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c6800640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8c80b0880 0x7fb8c80b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c6800640 1 -- 172.21.15.5:0/3582774588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c80ab020 con 0x7fb8ac004d40 2024-04-26T21:37:32.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c5e00640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8c80b0880 0x7fb8c80b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c7200640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c81ddcc0 0x7fb8c81de140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8c6800640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8c80aaae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8007b20 tx=0x7fb8b800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8bea00640 1 -- 172.21.15.5:0/3582774588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8013420 con 0x7fb8ac004d40 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8bea00640 1 -- 172.21.15.5:0/3582774588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b8018070 con 0x7fb8ac004d40 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8bea00640 1 -- 172.21.15.5:0/3582774588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8013800 con 0x7fb8ac004d40 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.966+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c80aa400 con 0x7fb8ac004d40 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.967+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c80ad100 con 0x7fb8ac004d40 2024-04-26T21:37:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.968+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c8075db0 con 0x7fb8ac004d40 2024-04-26T21:37:32.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.969+0000 7fb8bea00640 1 -- 172.21.15.5:0/3582774588 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8b80139a0 con 0x7fb8ac004d40 2024-04-26T21:37:32.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.970+0000 7fb8bea00640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb8a406c940 0x7fb8a406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:32.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.970+0000 7fb8bea00640 1 -- 172.21.15.5:0/3582774588 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb8b808c4e0 con 0x7fb8ac004d40 2024-04-26T21:37:32.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.970+0000 7fb8c5e00640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb8a406c940 0x7fb8a406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:32.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.972+0000 7fb8c5e00640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb8a406c940 0x7fb8a406ee00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8c81d8600 tx=0x7fb8b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:32.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:32.975+0000 7fb8bea00640 1 -- 172.21.15.5:0/3582774588 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb8b805a740 con 0x7fb8ac004d40 2024-04-26T21:37:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.179+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb8c80acb40 con 0x7fb8ac004d40 2024-04-26T21:37:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.180+0000 7fb8bea00640 1 -- 172.21.15.5:0/3582774588 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fb8b805a040 con 0x7fb8ac004d40 2024-04-26T21:37:33.181 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb8a406c940 msgr2=0x7fb8a406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb8a406c940 0x7fb8a406ee00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8c81d8600 tx=0x7fb8b0008040 comp rx=0 tx=0).stop 2024-04-26T21:37:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 msgr2=0x7fb8c80aaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8c80aaae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8007b20 tx=0x7fb8b800e530 comp rx=0 tx=0).stop 2024-04-26T21:37:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 shutdown_connections 2024-04-26T21:37:33.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8c81ddcc0 0x7fb8c81de140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8c80b0880 0x7fb8c80b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb8a406c940 0x7fb8a406ee00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 --2- 172.21.15.5:0/3582774588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ac004d40 0x7fb8c80aaae0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 >> 172.21.15.5:0/3582774588 conn(0x7fb8c8068720 msgr2=0x7fb8c80bb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:33.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 shutdown_connections 2024-04-26T21:37:33.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.184+0000 7fb8cd400640 1 -- 172.21.15.5:0/3582774588 wait complete. 2024-04-26T21:37:33.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:37:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.406+0000 7faafb200640 1 Processor -- start 2024-04-26T21:37:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.406+0000 7faafb200640 1 -- start start 2024-04-26T21:37:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.407+0000 7faafb200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faaf40b4650 0x7faaf40b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.408+0000 7faafb200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf413f0a0 0x7faaf413f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.408+0000 7faafb200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf40b4a30 con 0x7faaf40b0ee0 2024-04-26T21:37:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.408+0000 7faafb200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faaf4145810 con 0x7faaf40b4650 2024-04-26T21:37:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.408+0000 7faafb200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faaf4070740 con 0x7faaf413f0a0 2024-04-26T21:37:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.408+0000 7faafa800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf413f0a0 0x7faaf413f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.408+0000 7faaf9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faaf40b4650 0x7faaf40b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.408+0000 7faaf9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faaf40b4650 0x7faaf40b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:32918/0 (socket says 172.21.15.5:32918) 2024-04-26T21:37:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.409+0000 7faaf9e00640 1 -- 172.21.15.5:0/4131881865 learned_addr learned my addr 172.21.15.5:0/4131881865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.409+0000 7faaf9e00640 1 -- 172.21.15.5:0/4131881865 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf413f0a0 msgr2=0x7faaf413f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.409+0000 7faaf9e00640 1 --2- 172.21.15.5:0/4131881865 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf413f0a0 0x7faaf413f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.409+0000 7faaf9e00640 1 -- 172.21.15.5:0/4131881865 >> v1:172.21.15.112:6789/0 conn(0x7faaf40b0ee0 legacy=0x7faaf4145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.409+0000 7faaf9e00640 1 -- 172.21.15.5:0/4131881865 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf40b3720 con 0x7faaf40b4650 2024-04-26T21:37:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.411+0000 7faaf9e00640 1 --2- 172.21.15.5:0/4131881865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf40b3010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faae8009870 tx=0x7faae802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f67f80847fb746b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.411+0000 7faaf8a00640 1 -- 172.21.15.5:0/4131881865 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8037070 con 0x7faaf40b4650 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.411+0000 7faaf8a00640 1 -- 172.21.15.5:0/4131881865 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae8032440 con 0x7faaf40b4650 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.411+0000 7faaf8a00640 1 -- 172.21.15.5:0/4131881865 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8032810 con 0x7faaf40b4650 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 -- 172.21.15.5:0/4131881865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 msgr2=0x7faaf40b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 --2- 172.21.15.5:0/4131881865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf40b3010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faae8009870 tx=0x7faae802a1c0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 -- 172.21.15.5:0/4131881865 shutdown_connections 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 --2- 172.21.15.5:0/4131881865 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf413f0a0 0x7faaf413f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 --2- 172.21.15.5:0/4131881865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf40b3010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 -- 172.21.15.5:0/4131881865 >> 172.21.15.5:0/4131881865 conn(0x7faaf406c300 msgr2=0x7faaf406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 -- 172.21.15.5:0/4131881865 shutdown_connections 2024-04-26T21:37:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.412+0000 7faafb200640 1 -- 172.21.15.5:0/4131881865 wait complete. 2024-04-26T21:37:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.413+0000 7faafb200640 1 Processor -- start 2024-04-26T21:37:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.414+0000 7faafb200640 1 -- start start 2024-04-26T21:37:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.414+0000 7faafb200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf40b0ee0 0x7faaf413e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.414+0000 7faafb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf4073240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.414+0000 7faafb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaf413f0a0 0x7faaf41405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.414+0000 7faafb200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faaf414fb30 con 0x7faaf413f0a0 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.414+0000 7faafb200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40b0ad0 con 0x7faaf40b4650 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.414+0000 7faafb200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faaf414fcb0 con 0x7faaf40b0ee0 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaf413f0a0 0x7faaf41405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaf413f0a0 0x7faaf41405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38182/0 (socket says 172.21.15.5:38182) 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 -- 172.21.15.5:0/1161917405 learned_addr learned my addr 172.21.15.5:0/1161917405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faaf9e00640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf40b0ee0 0x7faaf413e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faaf9400640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf4073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 -- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf40b0ee0 msgr2=0x7faaf413e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf40b0ee0 0x7faaf413e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 -- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 msgr2=0x7faaf4073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf4073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faafa800640 1 -- 172.21.15.5:0/1161917405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf4071fd0 con 0x7faaf413f0a0 2024-04-26T21:37:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.415+0000 7faaf9400640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf4073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.416+0000 7faafa800640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaf413f0a0 0x7faaf41405c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faaf000efc0 tx=0x7faaf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.416+0000 7faaee000640 1 -- 172.21.15.5:0/1161917405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0018020 con 0x7faaf413f0a0 2024-04-26T21:37:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.416+0000 7faaee000640 1 -- 172.21.15.5:0/1161917405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf0014480 con 0x7faaf413f0a0 2024-04-26T21:37:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.416+0000 7faaee000640 1 -- 172.21.15.5:0/1161917405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0014870 con 0x7faaf413f0a0 2024-04-26T21:37:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.416+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf413fe50 con 0x7faaf413f0a0 2024-04-26T21:37:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.416+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf4071cf0 con 0x7faaf413f0a0 2024-04-26T21:37:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.417+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf40b2e30 con 0x7faaf413f0a0 2024-04-26T21:37:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.418+0000 7faaee000640 1 -- 172.21.15.5:0/1161917405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faaf0005d10 con 0x7faaf413f0a0 2024-04-26T21:37:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.419+0000 7faaee000640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faad806c8f0 0x7faad806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.419+0000 7faaee000640 1 -- 172.21.15.5:0/1161917405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faaf008c900 con 0x7faaf413f0a0 2024-04-26T21:37:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.420+0000 7faaf9e00640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faad806c8f0 0x7faad806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.421+0000 7faaf9e00640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faad806c8f0 0x7faad806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faae8034000 tx=0x7faae802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.424+0000 7faaee000640 1 -- 172.21.15.5:0/1161917405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faaf40b2e30 con 0x7faaf413f0a0 2024-04-26T21:37:33.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.648+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faaf4075db0 con 0x7faaf413f0a0 2024-04-26T21:37:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.648+0000 7faaee000640 1 -- 172.21.15.5:0/1161917405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7faaf0022070 con 0x7faaf413f0a0 2024-04-26T21:37:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faad806c8f0 msgr2=0x7faad806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faad806c8f0 0x7faad806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faae8034000 tx=0x7faae802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaf413f0a0 msgr2=0x7faaf41405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaf413f0a0 0x7faaf41405c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faaf000efc0 tx=0x7faaf000c490 comp rx=0 tx=0).stop 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 shutdown_connections 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faad806c8f0 0x7faad806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaf413f0a0 0x7faaf41405c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faaf40b4650 0x7faaf4073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 --2- 172.21.15.5:0/1161917405 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faaf40b0ee0 0x7faaf413e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.651+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 >> 172.21.15.5:0/1161917405 conn(0x7faaf406c300 msgr2=0x7faaf40b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.652+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 shutdown_connections 2024-04-26T21:37:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.652+0000 7faafb200640 1 -- 172.21.15.5:0/1161917405 wait complete. 2024-04-26T21:37:33.671 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:37:33.671 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:37:33.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:33.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.927+0000 7f7393200640 1 Processor -- start 2024-04-26T21:37:33.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.927+0000 7f7393200640 1 -- start start 2024-04-26T21:37:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.929+0000 7f7393200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b4dd0 0x7f7394153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.929+0000 7f7393200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f739414c1a0 con 0x7f739414bdc0 2024-04-26T21:37:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.929+0000 7f7393200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73940aea20 con 0x7f73940b3300 2024-04-26T21:37:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.929+0000 7f7393200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f739414ca10 con 0x7f73940b4dd0 2024-04-26T21:37:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.929+0000 7f7391e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f739414bdc0 0x7f73940b46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37414/0 (socket says 172.21.15.5:37414) 2024-04-26T21:37:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.929+0000 7f7391e00640 1 -- 172.21.15.5:0/288791085 learned_addr learned my addr 172.21.15.5:0/288791085 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:33.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.929+0000 7f7392800640 1 --2- 172.21.15.5:0/288791085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b4dd0 0x7f7394153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.930+0000 7f7391400640 1 -- 172.21.15.5:0/288791085 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533781128 0 0) 0x7f739414c1a0 con 0x7f739414bdc0 2024-04-26T21:37:33.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.930+0000 7f7391400640 1 -- 172.21.15.5:0/288791085 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7378003520 con 0x7f739414bdc0 2024-04-26T21:37:33.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.930+0000 7f7391400640 1 -- 172.21.15.5:0/288791085 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4066560771 0 0) 0x7f7378003520 con 0x7f739414bdc0 2024-04-26T21:37:33.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.930+0000 7f7392800640 1 -- 172.21.15.5:0/288791085 >> v1:172.21.15.112:6789/0 conn(0x7f73940b3300 legacy=0x7f7394073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.930+0000 7f7392800640 1 -- 172.21.15.5:0/288791085 >> v1:172.21.15.5:6789/0 conn(0x7f739414bdc0 legacy=0x7f73940b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.930+0000 7f7392800640 1 -- 172.21.15.5:0/288791085 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739414c450 con 0x7f73940b4dd0 2024-04-26T21:37:33.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.931+0000 7f7392800640 1 --2- 172.21.15.5:0/288791085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b4dd0 0x7f7394153e90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f738c009dc0 tx=0x7f738c02a500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbe03f354f56df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:33.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.932+0000 7f7391400640 1 -- 172.21.15.5:0/288791085 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c035020 con 0x7f73940b4dd0 2024-04-26T21:37:33.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.932+0000 7f7391400640 1 -- 172.21.15.5:0/288791085 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738c007540 con 0x7f73940b4dd0 2024-04-26T21:37:33.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.932+0000 7f7391400640 1 -- 172.21.15.5:0/288791085 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384001670 con 0x7f73940b4dd0 2024-04-26T21:37:33.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.933+0000 7f7393200640 1 -- 172.21.15.5:0/288791085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b4dd0 msgr2=0x7f7394153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.933+0000 7f7393200640 1 --2- 172.21.15.5:0/288791085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b4dd0 0x7f7394153e90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f738c009dc0 tx=0x7f738c02a500 comp rx=0 tx=0).stop 2024-04-26T21:37:33.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.933+0000 7f7393200640 1 -- 172.21.15.5:0/288791085 shutdown_connections 2024-04-26T21:37:33.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.933+0000 7f7393200640 1 --2- 172.21.15.5:0/288791085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b4dd0 0x7f7394153e90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.933+0000 7f7393200640 1 -- 172.21.15.5:0/288791085 >> 172.21.15.5:0/288791085 conn(0x7f739406c300 msgr2=0x7f739406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:33.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.933+0000 7f7393200640 1 -- 172.21.15.5:0/288791085 shutdown_connections 2024-04-26T21:37:33.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.933+0000 7f7393200640 1 -- 172.21.15.5:0/288791085 wait complete. 2024-04-26T21:37:33.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.935+0000 7f7393200640 1 Processor -- start 2024-04-26T21:37:33.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.935+0000 7f7393200640 1 -- start start 2024-04-26T21:37:33.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7393200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b3300 0x7f7394122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7393200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73940b4dd0 0x7f73941ddc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7393200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739414bdc0 0x7f73941de160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7393200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73940b0000 con 0x7f739414bdc0 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7393200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73940afe80 con 0x7f73940b4dd0 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7393200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7394073ca0 con 0x7f73940b3300 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7392800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739414bdc0 0x7f73941de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7392800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739414bdc0 0x7f73941de160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38186/0 (socket says 172.21.15.5:38186) 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7392800640 1 -- 172.21.15.5:0/2303977034 learned_addr learned my addr 172.21.15.5:0/2303977034 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7391e00640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b3300 0x7f7394122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.936+0000 7f7389400640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73940b4dd0 0x7f73941ddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7392800640 1 -- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b3300 msgr2=0x7f7394122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7392800640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b3300 0x7f7394122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7392800640 1 -- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73940b4dd0 msgr2=0x7f73941ddc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7392800640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73940b4dd0 0x7f73941ddc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7392800640 1 -- 172.21.15.5:0/2303977034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7394121a80 con 0x7f739414bdc0 2024-04-26T21:37:33.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7391e00640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b3300 0x7f7394122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7392800640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739414bdc0 0x7f73941de160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f738c02aaf0 tx=0x7f738c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f738aa00640 1 -- 172.21.15.5:0/2303977034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c03f070 con 0x7f739414bdc0 2024-04-26T21:37:33.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f738aa00640 1 -- 172.21.15.5:0/2303977034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738c003b90 con 0x7f739414bdc0 2024-04-26T21:37:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7394124130 con 0x7f739414bdc0 2024-04-26T21:37:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.937+0000 7f738aa00640 1 -- 172.21.15.5:0/2303977034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c035070 con 0x7f739414bdc0 2024-04-26T21:37:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.938+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7394121d20 con 0x7f739414bdc0 2024-04-26T21:37:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.939+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7394075db0 con 0x7f739414bdc0 2024-04-26T21:37:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.940+0000 7f738aa00640 1 -- 172.21.15.5:0/2303977034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f738c042070 con 0x7f739414bdc0 2024-04-26T21:37:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.941+0000 7f738aa00640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f737006c8f0 0x7f737006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.941+0000 7f738aa00640 1 -- 172.21.15.5:0/2303977034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f738c0ace50 con 0x7f739414bdc0 2024-04-26T21:37:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.942+0000 7f7391e00640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f737006c8f0 0x7f737006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:33.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.943+0000 7f7391e00640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f737006c8f0 0x7f737006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7384000f60 tx=0x7f7384009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:33.946+0000 7f738aa00640 1 -- 172.21.15.5:0/2303977034 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f738c07af30 con 0x7f739414bdc0 2024-04-26T21:37:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.153+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7394149ef0 con 0x7f739414bdc0 2024-04-26T21:37:34.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.156+0000 7f738aa00640 1 -- 172.21.15.5:0/2303977034 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f738c07a830 con 0x7f739414bdc0 2024-04-26T21:37:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:34.157 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f737006c8f0 msgr2=0x7f737006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f737006c8f0 0x7f737006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7384000f60 tx=0x7f7384009040 comp rx=0 tx=0).stop 2024-04-26T21:37:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739414bdc0 msgr2=0x7f73941de160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739414bdc0 0x7f73941de160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f738c02aaf0 tx=0x7f738c004a40 comp rx=0 tx=0).stop 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 shutdown_connections 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f737006c8f0 0x7f737006edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739414bdc0 0x7f73941de160 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73940b4dd0 0x7f73941ddc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 --2- 172.21.15.5:0/2303977034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73940b3300 0x7f7394122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 >> 172.21.15.5:0/2303977034 conn(0x7f739406c300 msgr2=0x7f73940b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 shutdown_connections 2024-04-26T21:37:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.159+0000 7f7393200640 1 -- 172.21.15.5:0/2303977034 wait complete. 2024-04-26T21:37:34.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:37:14.651248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:37:15.859697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:37:19.462053+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:37:34.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:37:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.388+0000 7f91a5600640 1 Processor -- start 2024-04-26T21:37:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.388+0000 7f91a5600640 1 -- start start 2024-04-26T21:37:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.389+0000 7f91a5600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f91a00b3cf0 0x7f91a0148f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.389+0000 7f91a5600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a00af320 con 0x7f91a0149490 2024-04-26T21:37:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.389+0000 7f91a5600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a00b2300 con 0x7f91a00aef40 2024-04-26T21:37:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.389+0000 7f91a5600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f91a006ed60 con 0x7f91a00b3cf0 2024-04-26T21:37:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.389+0000 7f919f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91a0149490 0x7f91a014fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56062/0 (socket says 172.21.15.5:56062) 2024-04-26T21:37:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.389+0000 7f919f400640 1 -- 172.21.15.5:0/888606572 learned_addr learned my addr 172.21.15.5:0/888606572 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f9197e00640 1 --2- 172.21.15.5:0/888606572 >> v2:172.21.15.112:3300/0 conn(0x7f91a00b3cf0 0x7f91a0148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957309398 0 0) 0x7f91a00af320 con 0x7f91a0149490 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9184003520 con 0x7f91a0149490 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3288816869 0 0) 0x7f9184003520 con 0x7f91a0149490 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 >> v2:172.21.15.112:3300/0 conn(0x7f91a00b3cf0 msgr2=0x7f91a0148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 --2- 172.21.15.5:0/888606572 >> v2:172.21.15.112:3300/0 conn(0x7f91a00b3cf0 0x7f91a0148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 >> v1:172.21.15.112:6789/0 conn(0x7f91a00aef40 legacy=0x7f91a00b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a006e860 con 0x7f91a0149490 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f91980019f0 con 0x7f91a0149490 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 >> v1:172.21.15.5:6789/0 conn(0x7f91a0149490 legacy=0x7f91a014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91840039b0 0x7f9184003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.390+0000 7f919e000640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9184004800 0x7f9184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f919e000640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91840051c0 0x7f918400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91a006ed60 con 0x7f9184004800 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f918400e370 con 0x7f91840051c0 2024-04-26T21:37:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f918400e570 con 0x7f91840039b0 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f9197e00640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9184004800 0x7f9184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f919ea00640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91840039b0 0x7f9184003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f919f400640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91840051c0 0x7f918400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f9197e00640 1 -- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91840039b0 msgr2=0x7f9184003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f9197e00640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91840039b0 0x7f9184003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f9197e00640 1 -- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91840051c0 msgr2=0x7f918400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f9197e00640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91840051c0 0x7f918400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f9197e00640 1 -- 172.21.15.5:0/888606572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9184003520 con 0x7f9184004800 2024-04-26T21:37:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.391+0000 7f919f400640 1 -- 172.21.15.5:0/888606572 reap_dead start 2024-04-26T21:37:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.392+0000 7f9197e00640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9184004800 0x7f9184004c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9188009ac0 tx=0x7f9184005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58aa4d65c6d6f308 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.393+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188036070 con 0x7f9184004800 2024-04-26T21:37:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.393+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188031400 con 0x7f9184004800 2024-04-26T21:37:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.393+0000 7f919e000640 1 -- 172.21.15.5:0/888606572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188009690 con 0x7f9184004800 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.393+0000 7f91a5600640 1 -- 172.21.15.5:0/888606572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9184004800 msgr2=0x7f9184004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.393+0000 7f91a5600640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9184004800 0x7f9184004c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9188009ac0 tx=0x7f9184005830 comp rx=0 tx=0).stop 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.394+0000 7f91a5600640 1 -- 172.21.15.5:0/888606572 shutdown_connections 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.394+0000 7f91a5600640 1 --2- 172.21.15.5:0/888606572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9184004800 0x7f9184004c80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.394+0000 7f91a5600640 1 -- 172.21.15.5:0/888606572 >> 172.21.15.5:0/888606572 conn(0x7f91a00b7bb0 msgr2=0x7f91a00b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.394+0000 7f91a5600640 1 -- 172.21.15.5:0/888606572 shutdown_connections 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.394+0000 7f91a5600640 1 -- 172.21.15.5:0/888606572 wait complete. 2024-04-26T21:37:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.395+0000 7f91a5600640 1 Processor -- start 2024-04-26T21:37:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.396+0000 7f91a5600640 1 -- start start 2024-04-26T21:37:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.396+0000 7f91a5600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9184004800 0x7f91a01473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.396+0000 7f91a5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a01df440 0x7f91a0141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.396+0000 7f91a5600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a01df8a0 0x7f91a01423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.396+0000 7f91a5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91a006d550 con 0x7f91a01df440 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.396+0000 7f91a5600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f91a00b3150 con 0x7f9184004800 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.396+0000 7f91a5600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f91a00b2a70 con 0x7f91a01df8a0 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a01df440 0x7f91a0141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a01df440 0x7f91a0141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49110/0 (socket says 172.21.15.5:49110) 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 -- 172.21.15.5:0/2926284444 learned_addr learned my addr 172.21.15.5:0/2926284444 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f919ea00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9184004800 0x7f91a01473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 -- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a01df8a0 msgr2=0x7f91a01423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a01df8a0 0x7f91a01423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 -- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9184004800 msgr2=0x7f91a01473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9184004800 0x7f91a01473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f9197e00640 1 -- 172.21.15.5:0/2926284444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a0146b90 con 0x7f91a01df440 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.397+0000 7f919ea00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9184004800 0x7f91a01473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.398+0000 7f9197e00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a01df440 0x7f91a0141e60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f918802abb0 tx=0x7f9188004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.398+0000 7f9196a00640 1 -- 172.21.15.5:0/2926284444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918803f020 con 0x7f91a01df440 2024-04-26T21:37:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.398+0000 7f9196a00640 1 -- 172.21.15.5:0/2926284444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188037040 con 0x7f91a01df440 2024-04-26T21:37:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.398+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a01de3b0 con 0x7f91a01df440 2024-04-26T21:37:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.398+0000 7f9196a00640 1 -- 172.21.15.5:0/2926284444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188036070 con 0x7f91a01df440 2024-04-26T21:37:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.398+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a01cea30 con 0x7f91a01df440 2024-04-26T21:37:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.399+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a00b4190 con 0x7f91a01df440 2024-04-26T21:37:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.400+0000 7f9196a00640 1 -- 172.21.15.5:0/2926284444 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9188042020 con 0x7f91a01df440 2024-04-26T21:37:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.401+0000 7f9196a00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f917c06c920 0x7f917c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.401+0000 7f9196a00640 1 -- 172.21.15.5:0/2926284444 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f91880abeb0 con 0x7f91a01df440 2024-04-26T21:37:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.402+0000 7f919ea00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f917c06c920 0x7f917c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.403+0000 7f919ea00640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f917c06c920 0x7f917c06ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c00 tx=0x7f9190009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.407+0000 7f9196a00640 1 -- 172.21.15.5:0/2926284444 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f91a00b4190 con 0x7f91a01df440 2024-04-26T21:37:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.611+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91a0075db0 con 0x7f91a01df440 2024-04-26T21:37:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.612+0000 7f9196a00640 1 -- 172.21.15.5:0/2926284444 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f9188049030 con 0x7f91a01df440 2024-04-26T21:37:34.613 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T21:37:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f917c06c920 msgr2=0x7f917c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f917c06c920 0x7f917c06ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c00 tx=0x7f9190009040 comp rx=0 tx=0).stop 2024-04-26T21:37:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a01df440 msgr2=0x7f91a0141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a01df440 0x7f91a0141e60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f918802abb0 tx=0x7f9188004730 comp rx=0 tx=0).stop 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 shutdown_connections 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91a01df8a0 0x7f91a01423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f917c06c920 0x7f917c06ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91a01df440 0x7f91a0141e60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 --2- 172.21.15.5:0/2926284444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9184004800 0x7f91a01473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 >> 172.21.15.5:0/2926284444 conn(0x7f91a00b7bb0 msgr2=0x7f91a00b8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 shutdown_connections 2024-04-26T21:37:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.615+0000 7f91a5600640 1 -- 172.21.15.5:0/2926284444 wait complete. 2024-04-26T21:37:34.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:37:34.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.847+0000 7fb1b5000640 1 Processor -- start 2024-04-26T21:37:34.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.848+0000 7fb1b5000640 1 -- start start 2024-04-26T21:37:34.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.849+0000 7fb1b5000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1b01428b0 0x7fb1b00b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.849+0000 7fb1b5000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1b00b6d90 con 0x7fb1b0148fd0 2024-04-26T21:37:34.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.849+0000 7fb1b5000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1b01487d0 con 0x7fb1b00b69b0 2024-04-26T21:37:34.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.849+0000 7fb1b5000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb1b0148ab0 con 0x7fb1b01428b0 2024-04-26T21:37:34.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.849+0000 7fb1aea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1b0148fd0 0x7fb1b01421a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56070/0 (socket says 172.21.15.5:56070) 2024-04-26T21:37:34.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.849+0000 7fb1aea00640 1 -- 172.21.15.5:0/1568855213 learned_addr learned my addr 172.21.15.5:0/1568855213 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:34.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.849+0000 7fb1afe00640 1 --2- 172.21.15.5:0/1568855213 >> v2:172.21.15.5:3300/0 conn(0x7fb1b01428b0 0x7fb1b00b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.850+0000 7fb1afe00640 1 -- 172.21.15.5:0/1568855213 >> v1:172.21.15.112:6789/0 conn(0x7fb1b00b69b0 legacy=0x7fb1b00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:34.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.850+0000 7fb1afe00640 1 -- 172.21.15.5:0/1568855213 >> v1:172.21.15.5:6789/0 conn(0x7fb1b0148fd0 legacy=0x7fb1b01421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.850+0000 7fb1afe00640 1 -- 172.21.15.5:0/1568855213 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b01484a0 con 0x7fb1b01428b0 2024-04-26T21:37:34.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.850+0000 7fb1ae000640 1 -- 172.21.15.5:0/1568855213 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900788169 0 0) 0x7fb1b00b6d90 con 0x7fb1b0148fd0 2024-04-26T21:37:34.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.851+0000 7fb1afe00640 1 --2- 172.21.15.5:0/1568855213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b01428b0 0x7fb1b00b87d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009d90 tx=0x7fb1a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602b3975eae7675a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.851+0000 7fb1ae000640 1 -- 172.21.15.5:0/1568855213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8007740 con 0x7fb1b01428b0 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.851+0000 7fb1ae000640 1 -- 172.21.15.5:0/1568855213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a80078e0 con 0x7fb1b01428b0 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.851+0000 7fb1ae000640 1 -- 172.21.15.5:0/1568855213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8007cb0 con 0x7fb1b01428b0 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.852+0000 7fb1b5000640 1 -- 172.21.15.5:0/1568855213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b01428b0 msgr2=0x7fb1b00b87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.852+0000 7fb1b5000640 1 --2- 172.21.15.5:0/1568855213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b01428b0 0x7fb1b00b87d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009d90 tx=0x7fb1a802a6a0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.852+0000 7fb1b5000640 1 -- 172.21.15.5:0/1568855213 shutdown_connections 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.852+0000 7fb1b5000640 1 --2- 172.21.15.5:0/1568855213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b01428b0 0x7fb1b00b87d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.852+0000 7fb1b5000640 1 -- 172.21.15.5:0/1568855213 >> 172.21.15.5:0/1568855213 conn(0x7fb1b00bde50 msgr2=0x7fb1b00be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.852+0000 7fb1b5000640 1 -- 172.21.15.5:0/1568855213 shutdown_connections 2024-04-26T21:37:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.852+0000 7fb1b5000640 1 -- 172.21.15.5:0/1568855213 wait complete. 2024-04-26T21:37:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.853+0000 7fb1b5000640 1 Processor -- start 2024-04-26T21:37:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.854+0000 7fb1b5000640 1 -- start start 2024-04-26T21:37:34.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.854+0000 7fb1b5000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b00b69b0 0x7fb1b00bd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.854+0000 7fb1b5000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b01428b0 0x7fb1b014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.854+0000 7fb1b5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b0148fd0 0x7fb1b012fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.854+0000 7fb1b5000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b0153fb0 con 0x7fb1b0148fd0 2024-04-26T21:37:34.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.854+0000 7fb1b5000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b0153e30 con 0x7fb1b00b69b0 2024-04-26T21:37:34.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.854+0000 7fb1b5000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b0154130 con 0x7fb1b01428b0 2024-04-26T21:37:34.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b0148fd0 0x7fb1b012fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b0148fd0 0x7fb1b012fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49136/0 (socket says 172.21.15.5:49136) 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 -- 172.21.15.5:0/863326949 learned_addr learned my addr 172.21.15.5:0/863326949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1aea00640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b01428b0 0x7fb1b014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1af400640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b00b69b0 0x7fb1b00bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 -- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b01428b0 msgr2=0x7fb1b014aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b01428b0 0x7fb1b014aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 -- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b00b69b0 msgr2=0x7fb1b00bd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b00b69b0 0x7fb1b00bd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 -- 172.21.15.5:0/863326949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b014a4c0 con 0x7fb1b0148fd0 2024-04-26T21:37:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1af400640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b00b69b0 0x7fb1b00bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:34.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.855+0000 7fb1afe00640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b0148fd0 0x7fb1b012fb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009eb0 tx=0x7fb1a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:34.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.856+0000 7fb1a7400640 1 -- 172.21.15.5:0/863326949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8040070 con 0x7fb1b0148fd0 2024-04-26T21:37:34.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.856+0000 7fb1a7400640 1 -- 172.21.15.5:0/863326949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a8031c90 con 0x7fb1b0148fd0 2024-04-26T21:37:34.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.856+0000 7fb1a7400640 1 -- 172.21.15.5:0/863326949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8045680 con 0x7fb1b0148fd0 2024-04-26T21:37:34.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.856+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b014c1c0 con 0x7fb1b0148fd0 2024-04-26T21:37:34.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.856+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b014a040 con 0x7fb1b0148fd0 2024-04-26T21:37:34.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.857+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b00b9f20 con 0x7fb1b0148fd0 2024-04-26T21:37:34.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.858+0000 7fb1a7400640 1 -- 172.21.15.5:0/863326949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1a8039040 con 0x7fb1b0148fd0 2024-04-26T21:37:34.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.859+0000 7fb1a7400640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb18c06c8f0 0x7fb18c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:34.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.859+0000 7fb1a7400640 1 -- 172.21.15.5:0/863326949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb1a80ada80 con 0x7fb1b0148fd0 2024-04-26T21:37:34.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.859+0000 7fb1af400640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb18c06c8f0 0x7fb18c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:34.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.861+0000 7fb1af400640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb18c06c8f0 0x7fb18c06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0003eb0 tx=0x7fb1a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:34.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:34.864+0000 7fb1a7400640 1 -- 172.21.15.5:0/863326949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb1b00b9f20 con 0x7fb1b0148fd0 2024-04-26T21:37:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.067+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb1b014a960 con 0x7fb1b0148fd0 2024-04-26T21:37:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.068+0000 7fb1a7400640 1 -- 172.21.15.5:0/863326949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fb1a80afe20 con 0x7fb1b0148fd0 2024-04-26T21:37:35.069 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb18c06c8f0 msgr2=0x7fb18c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb18c06c8f0 0x7fb18c06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0003eb0 tx=0x7fb1a0009040 comp rx=0 tx=0).stop 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b0148fd0 msgr2=0x7fb1b012fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b0148fd0 0x7fb1b012fb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009eb0 tx=0x7fb1a8004a40 comp rx=0 tx=0).stop 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 shutdown_connections 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb18c06c8f0 0x7fb18c06edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b0148fd0 0x7fb1b012fb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b01428b0 0x7fb1b014aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 --2- 172.21.15.5:0/863326949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b00b69b0 0x7fb1b00bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.071+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 >> 172.21.15.5:0/863326949 conn(0x7fb1b00bde50 msgr2=0x7fb1b00b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.072+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 shutdown_connections 2024-04-26T21:37:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.072+0000 7fb1b5000640 1 -- 172.21.15.5:0/863326949 wait complete. 2024-04-26T21:37:35.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:37:35.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.302+0000 7fb6d2400640 1 Processor -- start 2024-04-26T21:37:35.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.302+0000 7fb6d2400640 1 -- start start 2024-04-26T21:37:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.303+0000 7fb6d2400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 0x7fb6cc0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.303+0000 7fb6d2400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb6cc14c120 0x7fb6cc1420b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6d2400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6cc0beb30 con 0x7fb6cc0ba450 2024-04-26T21:37:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6d2400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc0b5c80 con 0x7fb6cc14c120 2024-04-26T21:37:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6d2400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b5630 con 0x7fb6cc0be750 2024-04-26T21:37:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6cbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb6cc0ba450 0x7fb6cc14ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56086/0 (socket says 172.21.15.5:56086) 2024-04-26T21:37:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6cbe00640 1 -- 172.21.15.5:0/3484729518 learned_addr learned my addr 172.21.15.5:0/3484729518 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:35.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6d1a00640 1 --2- 172.21.15.5:0/3484729518 >> v2:172.21.15.112:3300/0 conn(0x7fb6cc14c120 0x7fb6cc1420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6d1000640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 0x7fb6cc0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.304+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929363529 0 0) 0x7fb6cc0beb30 con 0x7fb6cc0ba450 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6b4003520 con 0x7fb6cc0ba450 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1461453668 0 0) 0x7fb6b4003520 con 0x7fb6cc0ba450 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 msgr2=0x7fb6cc0b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 0x7fb6cc0b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 >> v2:172.21.15.112:3300/0 conn(0x7fb6cc14c120 msgr2=0x7fb6cc1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 --2- 172.21.15.5:0/3484729518 >> v2:172.21.15.112:3300/0 conn(0x7fb6cc14c120 0x7fb6cc1420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc0b5910 con 0x7fb6cc0ba450 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fb6b8001670 con 0x7fb6cc0ba450 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 >> v1:172.21.15.5:6789/0 conn(0x7fb6cc0ba450 legacy=0x7fb6cc14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 0x7fb6b40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4003f30 0x7fb6b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6b4004d40 0x7fb6b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b5c80 con 0x7fb6b4003f30 2024-04-26T21:37:35.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b5630 con 0x7fb6b4004d40 2024-04-26T21:37:35.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.305+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b400b9c0 con 0x7fb6cc0be750 2024-04-26T21:37:35.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6cbe00640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4003f30 0x7fb6b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6d1000640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 0x7fb6b40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6d1a00640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6b4004d40 0x7fb6b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6cbe00640 1 -- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 msgr2=0x7fb6b40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:35.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6cbe00640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6cc0be750 0x7fb6b40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6cbe00640 1 -- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6b4004d40 msgr2=0x7fb6b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:35.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6cbe00640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6b4004d40 0x7fb6b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.306+0000 7fb6cbe00640 1 -- 172.21.15.5:0/3484729518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b4003520 con 0x7fb6b4003f30 2024-04-26T21:37:35.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.307+0000 7fb6cbe00640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4003f30 0x7fb6b4004800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c290 tx=0x7fb6b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2167f3f059e0f8f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:35.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.307+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8007d50 con 0x7fb6b4003f30 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.307+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b802e070 con 0x7fb6b4003f30 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.307+0000 7fb6cb400640 1 -- 172.21.15.5:0/3484729518 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8005d70 con 0x7fb6b4003f30 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.308+0000 7fb6d2400640 1 -- 172.21.15.5:0/3484729518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4003f30 msgr2=0x7fb6b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.308+0000 7fb6d2400640 1 --2- 172.21.15.5:0/3484729518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4003f30 0x7fb6b4004800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c290 tx=0x7fb6b4005830 comp rx=0 tx=0).stop 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.308+0000 7fb6d1a00640 1 -- 172.21.15.5:0/3484729518 reap_dead start 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.308+0000 7fb6d2400640 1 -- 172.21.15.5:0/3484729518 shutdown_connections 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.308+0000 7fb6d2400640 1 -- 172.21.15.5:0/3484729518 >> 172.21.15.5:0/3484729518 conn(0x7fb6cc0686c0 msgr2=0x7fb6cc0bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.308+0000 7fb6d2400640 1 -- 172.21.15.5:0/3484729518 shutdown_connections 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.308+0000 7fb6d2400640 1 -- 172.21.15.5:0/3484729518 wait complete. 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.310+0000 7fb6d2400640 1 Processor -- start 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.310+0000 7fb6d2400640 1 -- start start 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d2400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6b4003f30 0x7fb6cc13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d2400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6cc1e0e00 0x7fb6cc1e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d2400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6cc145590 0x7fb6cc145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d2400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b6d40 con 0x7fb6cc145590 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d2400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0b6bc0 con 0x7fb6cc1e0e00 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d2400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc1425f0 con 0x7fb6b4003f30 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d1a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6cc145590 0x7fb6cc145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d1a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6cc145590 0x7fb6cc145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49162/0 (socket says 172.21.15.5:49162) 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d1a00640 1 -- 172.21.15.5:0/2796949425 learned_addr learned my addr 172.21.15.5:0/2796949425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6d1000640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6b4003f30 0x7fb6cc13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.311+0000 7fb6cbe00640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6cc1e0e00 0x7fb6cc1e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d1a00640 1 -- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6b4003f30 msgr2=0x7fb6cc13a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d1a00640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6b4003f30 0x7fb6cc13a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d1a00640 1 -- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6cc1e0e00 msgr2=0x7fb6cc1e1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d1a00640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6cc1e0e00 0x7fb6cc1e1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d1a00640 1 -- 172.21.15.5:0/2796949425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc1e17c0 con 0x7fb6cc145590 2024-04-26T21:37:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d1000640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6b4003f30 0x7fb6cc13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d1a00640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6cc145590 0x7fb6cc145a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0b9ad0 tx=0x7fb6c40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6c8c00640 1 -- 172.21.15.5:0/2796949425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011e10 con 0x7fb6cc145590 2024-04-26T21:37:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6c8c00640 1 -- 172.21.15.5:0/2796949425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c401b070 con 0x7fb6cc145590 2024-04-26T21:37:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc13ce00 con 0x7fb6cc145590 2024-04-26T21:37:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6c8c00640 1 -- 172.21.15.5:0/2796949425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4003990 con 0x7fb6cc145590 2024-04-26T21:37:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.312+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc0bd6b0 con 0x7fb6cc145590 2024-04-26T21:37:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.314+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc075db0 con 0x7fb6cc145590 2024-04-26T21:37:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.315+0000 7fb6c8c00640 1 -- 172.21.15.5:0/2796949425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6c4005d10 con 0x7fb6cc145590 2024-04-26T21:37:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.315+0000 7fb6c8c00640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb6ac06c8f0 0x7fb6ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.316+0000 7fb6c8c00640 1 -- 172.21.15.5:0/2796949425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb6c408c530 con 0x7fb6cc145590 2024-04-26T21:37:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.316+0000 7fb6d1000640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb6ac06c8f0 0x7fb6ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.317+0000 7fb6d1000640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb6ac06c8f0 0x7fb6ac06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009970 tx=0x7fb6c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.320+0000 7fb6c8c00640 1 -- 172.21.15.5:0/2796949425 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb6c4025020 con 0x7fb6cc145590 2024-04-26T21:37:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.527+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb6cc0008d0 con 0x7fb6cc145590 2024-04-26T21:37:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.527+0000 7fb6c8c00640 1 -- 172.21.15.5:0/2796949425 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fb6cc1e17c0 con 0x7fb6cc145590 2024-04-26T21:37:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-26T21:37:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb6ac06c8f0 msgr2=0x7fb6ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb6ac06c8f0 0x7fb6ac06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009970 tx=0x7fb6c0008040 comp rx=0 tx=0).stop 2024-04-26T21:37:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6cc145590 msgr2=0x7fb6cc145a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6cc145590 0x7fb6cc145a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0b9ad0 tx=0x7fb6c40115a0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 shutdown_connections 2024-04-26T21:37:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb6ac06c8f0 0x7fb6ac06edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6cc145590 0x7fb6cc145a10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6cc1e0e00 0x7fb6cc1e1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 --2- 172.21.15.5:0/2796949425 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6b4003f30 0x7fb6cc13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 >> 172.21.15.5:0/2796949425 conn(0x7fb6cc0686c0 msgr2=0x7fb6cc148af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 shutdown_connections 2024-04-26T21:37:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.530+0000 7fb6d2400640 1 -- 172.21.15.5:0/2796949425 wait complete. 2024-04-26T21:37:35.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:37:35.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.764+0000 7fad7b200640 1 Processor -- start 2024-04-26T21:37:35.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.764+0000 7fad7b200640 1 -- start start 2024-04-26T21:37:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.765+0000 7fad7b200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fad740b6d50 0x7fad74146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.765+0000 7fad7b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad74073d00 0x7fad74150d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.765+0000 7fad7b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad740b3bb0 con 0x7fad741469c0 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.765+0000 7fad7b200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fad74070c20 con 0x7fad740b6d50 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.765+0000 7fad7b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad740b6260 con 0x7fad74073d00 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.766+0000 7fad7a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad74073d00 0x7fad74150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.766+0000 7fad79e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fad740b6d50 0x7fad74146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.766+0000 7fad7a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad74073d00 0x7fad74150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:48732/0 (socket says 172.21.15.5:48732) 2024-04-26T21:37:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.766+0000 7fad79e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fad740b6d50 0x7fad74146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53748/0 (socket says 172.21.15.5:53748) 2024-04-26T21:37:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.766+0000 7fad7a800640 1 -- 172.21.15.5:0/3270258087 learned_addr learned my addr 172.21.15.5:0/3270258087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.767+0000 7fad79e00640 1 -- 172.21.15.5:0/3270258087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad74073d00 msgr2=0x7fad74150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.767+0000 7fad79e00640 1 --2- 172.21.15.5:0/3270258087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad74073d00 0x7fad74150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.767+0000 7fad79e00640 1 -- 172.21.15.5:0/3270258087 >> v1:172.21.15.112:6789/0 conn(0x7fad741469c0 legacy=0x7fad740735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.767+0000 7fad79e00640 1 -- 172.21.15.5:0/3270258087 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad740b7130 con 0x7fad740b6d50 2024-04-26T21:37:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.768+0000 7fad79e00640 1 --2- 172.21.15.5:0/3270258087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad740b6d50 0x7fad74146480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad680097a0 tx=0x7fad6802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7357f80ddb5e9c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad78a00640 1 -- 172.21.15.5:0/3270258087 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68037070 con 0x7fad740b6d50 2024-04-26T21:37:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad78a00640 1 -- 172.21.15.5:0/3270258087 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6802adb0 con 0x7fad740b6d50 2024-04-26T21:37:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad78a00640 1 -- 172.21.15.5:0/3270258087 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68032660 con 0x7fad740b6d50 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad7b200640 1 -- 172.21.15.5:0/3270258087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad740b6d50 msgr2=0x7fad74146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad7b200640 1 --2- 172.21.15.5:0/3270258087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad740b6d50 0x7fad74146480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad680097a0 tx=0x7fad6802a060 comp rx=0 tx=0).stop 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad7b200640 1 -- 172.21.15.5:0/3270258087 shutdown_connections 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad7b200640 1 --2- 172.21.15.5:0/3270258087 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad74073d00 0x7fad74150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad7b200640 1 --2- 172.21.15.5:0/3270258087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad740b6d50 0x7fad74146480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.769+0000 7fad7b200640 1 -- 172.21.15.5:0/3270258087 >> 172.21.15.5:0/3270258087 conn(0x7fad7406c720 msgr2=0x7fad7406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.770+0000 7fad7b200640 1 -- 172.21.15.5:0/3270258087 shutdown_connections 2024-04-26T21:37:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.770+0000 7fad7b200640 1 -- 172.21.15.5:0/3270258087 wait complete. 2024-04-26T21:37:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.771+0000 7fad7b200640 1 Processor -- start 2024-04-26T21:37:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.771+0000 7fad7b200640 1 -- start start 2024-04-26T21:37:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad74073d00 0x7fad740aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad741469c0 0x7fad740ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad741cce30 0x7fad741df240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fad740b5c40 con 0x7fad741cce30 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad74070700 con 0x7fad74073d00 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad740b0cd0 con 0x7fad741469c0 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad741cce30 0x7fad741df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad741cce30 0x7fad741df240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49168/0 (socket says 172.21.15.5:49168) 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad7a800640 1 -- 172.21.15.5:0/2527350868 learned_addr learned my addr 172.21.15.5:0/2527350868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.772+0000 7fad79e00640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad74073d00 0x7fad740aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad79400640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad741469c0 0x7fad740ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad7a800640 1 -- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad741469c0 msgr2=0x7fad740ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad7a800640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad741469c0 0x7fad740ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad7a800640 1 -- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad74073d00 msgr2=0x7fad740aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad7a800640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad74073d00 0x7fad740aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad7a800640 1 -- 172.21.15.5:0/2527350868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad740afb70 con 0x7fad741cce30 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad79e00640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad74073d00 0x7fad740aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad7a800640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad741cce30 0x7fad741df240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad7000efc0 tx=0x7fad7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad6e000640 1 -- 172.21.15.5:0/2527350868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7000cd20 con 0x7fad741cce30 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad6e000640 1 -- 172.21.15.5:0/2527350868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad70003990 con 0x7fad741cce30 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.773+0000 7fad6e000640 1 -- 172.21.15.5:0/2527350868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70003d80 con 0x7fad741cce30 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.774+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad741cd330 con 0x7fad741cce30 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.774+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad741d3380 con 0x7fad741cce30 2024-04-26T21:37:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.775+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad74075db0 con 0x7fad741cce30 2024-04-26T21:37:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.776+0000 7fad6e000640 1 -- 172.21.15.5:0/2527350868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad70005d10 con 0x7fad741cce30 2024-04-26T21:37:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.777+0000 7fad6e000640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fad5806c8f0 0x7fad5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.777+0000 7fad6e000640 1 -- 172.21.15.5:0/2527350868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fad7008c560 con 0x7fad741cce30 2024-04-26T21:37:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.777+0000 7fad79e00640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fad5806c8f0 0x7fad5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:35.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.778+0000 7fad79e00640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fad5806c8f0 0x7fad5806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad68034000 tx=0x7fad6802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.781+0000 7fad6e000640 1 -- 172.21.15.5:0/2527350868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fad70022020 con 0x7fad741cce30 2024-04-26T21:37:35.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.983+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fad740b7c10 con 0x7fad741cce30 2024-04-26T21:37:35.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.984+0000 7fad6e000640 1 -- 172.21.15.5:0/2527350868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fad741cd330 con 0x7fad741cce30 2024-04-26T21:37:35.984 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.986+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fad5806c8f0 msgr2=0x7fad5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.986+0000 7fad7b200640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fad5806c8f0 0x7fad5806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad68034000 tx=0x7fad6802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.986+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad741cce30 msgr2=0x7fad741df240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.986+0000 7fad7b200640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad741cce30 0x7fad741df240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad7000efc0 tx=0x7fad7000c490 comp rx=0 tx=0).stop 2024-04-26T21:37:35.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 shutdown_connections 2024-04-26T21:37:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fad5806c8f0 0x7fad5806edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad741cce30 0x7fad741df240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad741469c0 0x7fad740ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 --2- 172.21.15.5:0/2527350868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad74073d00 0x7fad740aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 >> 172.21.15.5:0/2527350868 conn(0x7fad7406c720 msgr2=0x7fad741443f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 shutdown_connections 2024-04-26T21:37:35.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:35.987+0000 7fad7b200640 1 -- 172.21.15.5:0/2527350868 wait complete. 2024-04-26T21:37:36.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:37:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.225+0000 7fd352800640 1 Processor -- start 2024-04-26T21:37:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.225+0000 7fd352800640 1 -- start start 2024-04-26T21:37:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.226+0000 7fd352800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd34c0b3360 0x7fd34c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.226+0000 7fd352800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd34c0b5fc0 0x7fd34c073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.226+0000 7fd352800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd34c070bc0 con 0x7fd34c146f80 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.226+0000 7fd352800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd34c0b43e0 con 0x7fd34c0b3360 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.226+0000 7fd352800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd34c071c20 con 0x7fd34c0b5fc0 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd351e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd34c146f80 0x7fd34c149880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56088/0 (socket says 172.21.15.5:56088) 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd351e00640 1 -- 172.21.15.5:0/933958681 learned_addr learned my addr 172.21.15.5:0/933958681 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd351400640 1 --2- 172.21.15.5:0/933958681 >> v2:172.21.15.5:3300/0 conn(0x7fd34c0b3360 0x7fd34c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd350a00640 1 --2- 172.21.15.5:0/933958681 >> v2:172.21.15.112:3300/0 conn(0x7fd34c0b5fc0 0x7fd34c073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd34be00640 1 -- 172.21.15.5:0/933958681 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657028237 0 0) 0x7fd34c070bc0 con 0x7fd34c146f80 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd34be00640 1 -- 172.21.15.5:0/933958681 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd330003520 con 0x7fd34c146f80 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd351400640 1 -- 172.21.15.5:0/933958681 >> v2:172.21.15.112:3300/0 conn(0x7fd34c0b5fc0 msgr2=0x7fd34c073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd351400640 1 --2- 172.21.15.5:0/933958681 >> v2:172.21.15.112:3300/0 conn(0x7fd34c0b5fc0 0x7fd34c073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd351400640 1 -- 172.21.15.5:0/933958681 >> v1:172.21.15.5:6789/0 conn(0x7fd34c146f80 legacy=0x7fd34c149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.227+0000 7fd351400640 1 -- 172.21.15.5:0/933958681 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c0b3740 con 0x7fd34c0b3360 2024-04-26T21:37:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.228+0000 7fd351400640 1 --2- 172.21.15.5:0/933958681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c0b3360 0x7fd34c146a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0b74e0 tx=0x7fd33c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17f30f0e4d23bec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd34be00640 1 -- 172.21.15.5:0/933958681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c007740 con 0x7fd34c0b3360 2024-04-26T21:37:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd34be00640 1 -- 172.21.15.5:0/933958681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33c0078e0 con 0x7fd34c0b3360 2024-04-26T21:37:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd34be00640 1 -- 172.21.15.5:0/933958681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c007cb0 con 0x7fd34c0b3360 2024-04-26T21:37:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd352800640 1 -- 172.21.15.5:0/933958681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c0b3360 msgr2=0x7fd34c146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd352800640 1 --2- 172.21.15.5:0/933958681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c0b3360 0x7fd34c146a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0b74e0 tx=0x7fd33c02a680 comp rx=0 tx=0).stop 2024-04-26T21:37:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd352800640 1 -- 172.21.15.5:0/933958681 shutdown_connections 2024-04-26T21:37:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd352800640 1 --2- 172.21.15.5:0/933958681 >> v2:172.21.15.112:3300/0 conn(0x7fd34c0b5fc0 0x7fd34c073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd352800640 1 --2- 172.21.15.5:0/933958681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c0b3360 0x7fd34c146a40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.229+0000 7fd352800640 1 -- 172.21.15.5:0/933958681 >> 172.21.15.5:0/933958681 conn(0x7fd34c06c300 msgr2=0x7fd34c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.230+0000 7fd352800640 1 -- 172.21.15.5:0/933958681 shutdown_connections 2024-04-26T21:37:36.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.230+0000 7fd352800640 1 -- 172.21.15.5:0/933958681 wait complete. 2024-04-26T21:37:36.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.231+0000 7fd352800640 1 Processor -- start 2024-04-26T21:37:36.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.231+0000 7fd352800640 1 -- start start 2024-04-26T21:37:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.232+0000 7fd352800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34c0b3360 0x7fd34c142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.232+0000 7fd352800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34c0b5fc0 0x7fd34c140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.232+0000 7fd352800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c146f80 0x7fd34c13db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.232+0000 7fd352800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c06ebc0 con 0x7fd34c146f80 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.232+0000 7fd352800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c146520 con 0x7fd34c0b3360 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.232+0000 7fd352800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd34c0b3d10 con 0x7fd34c0b5fc0 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c146f80 0x7fd34c13db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c146f80 0x7fd34c13db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49192/0 (socket says 172.21.15.5:49192) 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 -- 172.21.15.5:0/3211301420 learned_addr learned my addr 172.21.15.5:0/3211301420 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351400640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34c0b3360 0x7fd34c142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd350a00640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34c0b5fc0 0x7fd34c140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 -- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34c0b5fc0 msgr2=0x7fd34c140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34c0b5fc0 0x7fd34c140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 -- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34c0b3360 msgr2=0x7fd34c142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34c0b3360 0x7fd34c142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 -- 172.21.15.5:0/3211301420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c1411c0 con 0x7fd34c146f80 2024-04-26T21:37:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.233+0000 7fd351e00640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c146f80 0x7fd34c13db60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd34400c390 tx=0x7fd34400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.234+0000 7fd349600640 1 -- 172.21.15.5:0/3211301420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344017070 con 0x7fd34c146f80 2024-04-26T21:37:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.234+0000 7fd349600640 1 -- 172.21.15.5:0/3211301420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd344005ce0 con 0x7fd34c146f80 2024-04-26T21:37:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.234+0000 7fd349600640 1 -- 172.21.15.5:0/3211301420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344007310 con 0x7fd34c146f80 2024-04-26T21:37:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.234+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34c143480 con 0x7fd34c146f80 2024-04-26T21:37:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.234+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34c1cd4c0 con 0x7fd34c146f80 2024-04-26T21:37:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.235+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34c146d40 con 0x7fd34c146f80 2024-04-26T21:37:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.236+0000 7fd349600640 1 -- 172.21.15.5:0/3211301420 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd34401a070 con 0x7fd34c146f80 2024-04-26T21:37:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.237+0000 7fd349600640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd32c06c8f0 0x7fd32c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.237+0000 7fd349600640 1 -- 172.21.15.5:0/3211301420 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd34408b1c0 con 0x7fd34c146f80 2024-04-26T21:37:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.238+0000 7fd351400640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd32c06c8f0 0x7fd32c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.239+0000 7fd351400640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd32c06c8f0 0x7fd32c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.242+0000 7fd349600640 1 -- 172.21.15.5:0/3211301420 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd34c146d40 con 0x7fd34c146f80 2024-04-26T21:37:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.456+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd34c075db0 con 0x7fd34c146f80 2024-04-26T21:37:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.457+0000 7fd349600640 1 -- 172.21.15.5:0/3211301420 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fd344059340 con 0x7fd34c146f80 2024-04-26T21:37:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-26T21:37:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd32c06c8f0 msgr2=0x7fd32c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd32c06c8f0 0x7fd32c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02f000 comp rx=0 tx=0).stop 2024-04-26T21:37:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c146f80 msgr2=0x7fd34c13db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c146f80 0x7fd34c13db60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd34400c390 tx=0x7fd34400c850 comp rx=0 tx=0).stop 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 shutdown_connections 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd32c06c8f0 0x7fd32c06edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c146f80 0x7fd34c13db60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd34c0b5fc0 0x7fd34c140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 --2- 172.21.15.5:0/3211301420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd34c0b3360 0x7fd34c142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 >> 172.21.15.5:0/3211301420 conn(0x7fd34c06c300 msgr2=0x7fd34c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 shutdown_connections 2024-04-26T21:37:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.460+0000 7fd352800640 1 -- 172.21.15.5:0/3211301420 wait complete. 2024-04-26T21:37:36.479 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-04-26T21:37:36.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:36.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:37:36.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[38336]: fuse finished with error 0 and tester_r 0 2024-04-26T21:37:36.571 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:37:36.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T21:37:36.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:36.644 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T21:37:36.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.929+0000 7f447be00640 1 Processor -- start 2024-04-26T21:37:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.930+0000 7f447be00640 1 -- start start 2024-04-26T21:37:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.931+0000 7f447be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f447c142a20 0x7f447c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.931+0000 7f447be00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447c0bb260 con 0x7f447c0bae80 2024-04-26T21:37:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.931+0000 7f447be00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447c0b6270 con 0x7f447c148600 2024-04-26T21:37:36.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.931+0000 7f447be00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f447c0b6550 con 0x7f447c142a20 2024-04-26T21:37:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.931+0000 7f447aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f447c0bae80 0x7f447c142310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56100/0 (socket says 172.21.15.5:56100) 2024-04-26T21:37:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.932+0000 7f447aa00640 1 -- 172.21.15.5:0/3834126029 learned_addr learned my addr 172.21.15.5:0/3834126029 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.932+0000 7f447a000640 1 --2- 172.21.15.5:0/3834126029 >> v2:172.21.15.5:3300/0 conn(0x7f447c142a20 0x7f447c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.932+0000 7f447a000640 1 -- 172.21.15.5:0/3834126029 >> v1:172.21.15.112:6789/0 conn(0x7f447c148600 legacy=0x7f447c148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.932+0000 7f447a000640 1 -- 172.21.15.5:0/3834126029 >> v1:172.21.15.5:6789/0 conn(0x7f447c0bae80 legacy=0x7f447c142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.932+0000 7f447a000640 1 -- 172.21.15.5:0/3834126029 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c0b6830 con 0x7f447c142a20 2024-04-26T21:37:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.933+0000 7f447a000640 1 --2- 172.21.15.5:0/3834126029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c142a20 0x7f447c0b57d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4468009d90 tx=0x7f446802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7661a7cc3156f0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.933+0000 7f4479600640 1 -- 172.21.15.5:0/3834126029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468031600 con 0x7f447c142a20 2024-04-26T21:37:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.933+0000 7f4479600640 1 -- 172.21.15.5:0/3834126029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44680317a0 con 0x7f447c142a20 2024-04-26T21:37:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.933+0000 7f4479600640 1 -- 172.21.15.5:0/3834126029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468031b70 con 0x7f447c142a20 2024-04-26T21:37:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.934+0000 7f447be00640 1 -- 172.21.15.5:0/3834126029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c142a20 msgr2=0x7f447c0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.934+0000 7f447be00640 1 --2- 172.21.15.5:0/3834126029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c142a20 0x7f447c0b57d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4468009d90 tx=0x7f446802a610 comp rx=0 tx=0).stop 2024-04-26T21:37:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.934+0000 7f447be00640 1 -- 172.21.15.5:0/3834126029 shutdown_connections 2024-04-26T21:37:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.934+0000 7f447be00640 1 --2- 172.21.15.5:0/3834126029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c142a20 0x7f447c0b57d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.934+0000 7f447be00640 1 -- 172.21.15.5:0/3834126029 >> 172.21.15.5:0/3834126029 conn(0x7f447c0684b0 msgr2=0x7f447c0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.934+0000 7f447be00640 1 -- 172.21.15.5:0/3834126029 shutdown_connections 2024-04-26T21:37:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.934+0000 7f447be00640 1 -- 172.21.15.5:0/3834126029 wait complete. 2024-04-26T21:37:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.936+0000 7f447be00640 1 Processor -- start 2024-04-26T21:37:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.936+0000 7f447be00640 1 -- start start 2024-04-26T21:37:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f447c0bae80 0x7f447c14b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c142a20 0x7f447c13b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c148600 0x7f447c142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f447c153fa0 con 0x7f447c148600 2024-04-26T21:37:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f447c153e20 con 0x7f447c142a20 2024-04-26T21:37:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f447c154120 con 0x7f447c0bae80 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c148600 0x7f447c142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c148600 0x7f447c142e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49200/0 (socket says 172.21.15.5:49200) 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447b400640 1 -- 172.21.15.5:0/3127782074 learned_addr learned my addr 172.21.15.5:0/3127782074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447a000640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c142a20 0x7f447c13b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.937+0000 7f447aa00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f447c0bae80 0x7f447c14b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447b400640 1 -- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f447c0bae80 msgr2=0x7f447c14b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447b400640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f447c0bae80 0x7f447c14b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447b400640 1 -- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c142a20 msgr2=0x7f447c13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447b400640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c142a20 0x7f447c13b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447b400640 1 -- 172.21.15.5:0/3127782074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c13bce0 con 0x7f447c148600 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447b400640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c148600 0x7f447c142e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f447400b410 tx=0x7f447400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f4472a00640 1 -- 172.21.15.5:0/3127782074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474015030 con 0x7f447c148600 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f4472a00640 1 -- 172.21.15.5:0/3127782074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4474004020 con 0x7f447c148600 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f4472a00640 1 -- 172.21.15.5:0/3127782074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474004410 con 0x7f447c148600 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c13bfc0 con 0x7f447c148600 2024-04-26T21:37:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.938+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c145390 con 0x7f447c148600 2024-04-26T21:37:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.940+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447c145d60 con 0x7f447c148600 2024-04-26T21:37:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.940+0000 7f4472a00640 1 -- 172.21.15.5:0/3127782074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4474018070 con 0x7f447c148600 2024-04-26T21:37:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.941+0000 7f4472a00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f445c06c920 0x7f445c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.942+0000 7f4472a00640 1 -- 172.21.15.5:0/3127782074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f447408b9a0 con 0x7f447c148600 2024-04-26T21:37:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.942+0000 7f447aa00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f445c06c920 0x7f445c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.943+0000 7f447aa00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f445c06c920 0x7f445c06ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f446c000f60 tx=0x7f446c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:36.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:36.946+0000 7f4472a00640 1 -- 172.21.15.5:0/3127782074 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f447c145d60 con 0x7f447c148600 2024-04-26T21:37:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.150+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f447c0b46e0 con 0x7f447c148600 2024-04-26T21:37:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.152+0000 7f4472a00640 1 -- 172.21.15.5:0/3127782074 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f4474059a80 con 0x7f447c148600 2024-04-26T21:37:37.154 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:37.154 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.154+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f445c06c920 msgr2=0x7f445c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.154+0000 7f447be00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f445c06c920 0x7f445c06ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f446c000f60 tx=0x7f446c009040 comp rx=0 tx=0).stop 2024-04-26T21:37:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.154+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c148600 msgr2=0x7f447c142e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.154+0000 7f447be00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c148600 0x7f447c142e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f447400b410 tx=0x7f447400b8d0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 shutdown_connections 2024-04-26T21:37:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f445c06c920 0x7f445c06ede0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c148600 0x7f447c142e00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c142a20 0x7f447c13b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 --2- 172.21.15.5:0/3127782074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f447c0bae80 0x7f447c14b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 >> 172.21.15.5:0/3127782074 conn(0x7f447c0684b0 msgr2=0x7f447c1420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 shutdown_connections 2024-04-26T21:37:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.155+0000 7f447be00640 1 -- 172.21.15.5:0/3127782074 wait complete. 2024-04-26T21:37:37.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.385+0000 7f17f6a00640 1 Processor -- start 2024-04-26T21:37:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.385+0000 7f17f6a00640 1 -- start start 2024-04-26T21:37:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17f6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17f00b6e40 0x7f17f0145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17f6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 0x7f17f014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17f6a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f00b7220 con 0x7f17f00b0be0 2024-04-26T21:37:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17f6a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f17f0145860 con 0x7f17f00b6e40 2024-04-26T21:37:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17f6a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17f01454f0 con 0x7f17f0149060 2024-04-26T21:37:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17ef400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17f00b0be0 0x7f17f0148950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56102/0 (socket says 172.21.15.5:56102) 2024-04-26T21:37:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17ef400640 1 -- 172.21.15.5:0/358241075 learned_addr learned my addr 172.21.15.5:0/358241075 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:37.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17efe00640 1 --2- 172.21.15.5:0/358241075 >> v2:172.21.15.112:3300/0 conn(0x7f17f00b6e40 0x7f17f0145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.387+0000 7f17f4a00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 0x7f17f014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716104849 0 0) 0x7f17f00b7220 con 0x7f17f00b0be0 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17d4003520 con 0x7f17f00b0be0 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1380601877 0 0) 0x7f17d4003520 con 0x7f17f00b0be0 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 msgr2=0x7f17f014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 0x7f17f014fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 >> v2:172.21.15.112:3300/0 conn(0x7f17f00b6e40 msgr2=0x7f17f0145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 --2- 172.21.15.5:0/358241075 >> v2:172.21.15.112:3300/0 conn(0x7f17f00b6e40 0x7f17f0145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f00b30e0 con 0x7f17f00b0be0 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f17dc001670 con 0x7f17f00b0be0 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 >> v1:172.21.15.5:6789/0 conn(0x7f17f00b0be0 legacy=0x7f17f0148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40039b0 0x7f17d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d4004800 0x7f17d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 0x7f17d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01454f0 con 0x7f17d40039b0 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400b9c0 con 0x7f17d4004800 2024-04-26T21:37:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.388+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17d400bb90 con 0x7f17f0149060 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17efe00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40039b0 0x7f17d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17f4a00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 0x7f17d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17ef400640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d4004800 0x7f17d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17efe00640 1 -- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 msgr2=0x7f17d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17efe00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17f0149060 0x7f17d40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17efe00640 1 -- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d4004800 msgr2=0x7f17d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17efe00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d4004800 0x7f17d4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.389+0000 7f17efe00640 1 -- 172.21.15.5:0/358241075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d4003520 con 0x7f17d40039b0 2024-04-26T21:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.390+0000 7f17efe00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40039b0 0x7f17d4003dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f17e000e170 tx=0x7f17d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff395c6ea0e55d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.390+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0034020 con 0x7f17d40039b0 2024-04-26T21:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.390+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e0030430 con 0x7f17d40039b0 2024-04-26T21:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.390+0000 7f17eea00640 1 -- 172.21.15.5:0/358241075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0009c10 con 0x7f17d40039b0 2024-04-26T21:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.391+0000 7f17f6a00640 1 -- 172.21.15.5:0/358241075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40039b0 msgr2=0x7f17d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.391+0000 7f17f6a00640 1 --2- 172.21.15.5:0/358241075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d40039b0 0x7f17d4003dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f17e000e170 tx=0x7f17d4005830 comp rx=0 tx=0).stop 2024-04-26T21:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.391+0000 7f17f4a00640 1 -- 172.21.15.5:0/358241075 reap_dead start 2024-04-26T21:37:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.391+0000 7f17f6a00640 1 -- 172.21.15.5:0/358241075 shutdown_connections 2024-04-26T21:37:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.391+0000 7f17f6a00640 1 -- 172.21.15.5:0/358241075 >> 172.21.15.5:0/358241075 conn(0x7f17f006c720 msgr2=0x7f17f006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.391+0000 7f17f6a00640 1 -- 172.21.15.5:0/358241075 shutdown_connections 2024-04-26T21:37:37.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.391+0000 7f17f6a00640 1 -- 172.21.15.5:0/358241075 wait complete. 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.393+0000 7f17f6a00640 1 Processor -- start 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.393+0000 7f17f6a00640 1 -- start start 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17f6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d40039b0 0x7f17f01d8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17f6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f01d8ab0 0x7f17f01dec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17f6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01d8f10 0x7f17f01df1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17f6a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17f00b37f0 con 0x7f17f01d8ab0 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17f6a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17f00b6040 con 0x7f17f01d8f10 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17f6a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17f00b3970 con 0x7f17d40039b0 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f01d8ab0 0x7f17f01dec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f01d8ab0 0x7f17f01dec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49220/0 (socket says 172.21.15.5:49220) 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17ef400640 1 -- 172.21.15.5:0/2931826569 learned_addr learned my addr 172.21.15.5:0/2931826569 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17efe00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d40039b0 0x7f17f01d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17f4a00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01d8f10 0x7f17f01df1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17ef400640 1 -- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d40039b0 msgr2=0x7f17f01d8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17ef400640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d40039b0 0x7f17f01d8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17ef400640 1 -- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01d8f10 msgr2=0x7f17f01df1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.394+0000 7f17ef400640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01d8f10 0x7f17f01df1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.395+0000 7f17ef400640 1 -- 172.21.15.5:0/2931826569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f0142110 con 0x7f17f01d8ab0 2024-04-26T21:37:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.395+0000 7f17ef400640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f01d8ab0 0x7f17f01dec90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d770 tx=0x7f17dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.395+0000 7f17e7e00640 1 -- 172.21.15.5:0/2931826569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc019070 con 0x7f17f01d8ab0 2024-04-26T21:37:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.395+0000 7f17e7e00640 1 -- 172.21.15.5:0/2931826569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc0072d0 con 0x7f17f01d8ab0 2024-04-26T21:37:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.395+0000 7f17e7e00640 1 -- 172.21.15.5:0/2931826569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0047e0 con 0x7f17f01d8ab0 2024-04-26T21:37:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.395+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f0140430 con 0x7f17f01d8ab0 2024-04-26T21:37:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.395+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f0144dd0 con 0x7f17f01d8ab0 2024-04-26T21:37:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.397+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f0075db0 con 0x7f17f01d8ab0 2024-04-26T21:37:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.398+0000 7f17e7e00640 1 -- 172.21.15.5:0/2931826569 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17dc01c070 con 0x7f17f01d8ab0 2024-04-26T21:37:37.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.398+0000 7f17e7e00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17d006c940 0x7f17d006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.399+0000 7f17e7e00640 1 -- 172.21.15.5:0/2931826569 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f17dc08b650 con 0x7f17f01d8ab0 2024-04-26T21:37:37.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.399+0000 7f17efe00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17d006c940 0x7f17d006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.400+0000 7f17efe00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17d006c940 0x7f17d006ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17e0035000 tx=0x7f17e002f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:37.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.406+0000 7f17e7e00640 1 -- 172.21.15.5:0/2931826569 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f17dc059160 con 0x7f17f01d8ab0 2024-04-26T21:37:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.625+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17f00b5740 con 0x7f17f01d8ab0 2024-04-26T21:37:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.627+0000 7f17e7e00640 1 -- 172.21.15.5:0/2931826569 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f17dc05d460 con 0x7f17f01d8ab0 2024-04-26T21:37:37.627 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:37.628 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17d006c940 msgr2=0x7f17d006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17d006c940 0x7f17d006ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17e0035000 tx=0x7f17e002f000 comp rx=0 tx=0).stop 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f01d8ab0 msgr2=0x7f17f01dec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f01d8ab0 0x7f17f01dec90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d770 tx=0x7f17dc00dc30 comp rx=0 tx=0).stop 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 shutdown_connections 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01d8f10 0x7f17f01df1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17d006c940 0x7f17d006ee00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f01d8ab0 0x7f17f01dec90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 --2- 172.21.15.5:0/2931826569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17d40039b0 0x7f17f01d8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 >> 172.21.15.5:0/2931826569 conn(0x7f17f006c720 msgr2=0x7f17f0150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.630+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 shutdown_connections 2024-04-26T21:37:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.631+0000 7f17f6a00640 1 -- 172.21.15.5:0/2931826569 wait complete. 2024-04-26T21:37:37.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T21:37:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.866+0000 7fda87800640 1 Processor -- start 2024-04-26T21:37:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.866+0000 7fda87800640 1 -- start start 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.867+0000 7fda87800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda801401f0 0x7fda80140680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.867+0000 7fda87800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda8014ed70 0x7fda80151160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.867+0000 7fda87800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda800b3bb0 con 0x7fda8006e780 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.867+0000 7fda87800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fda8006eb60 con 0x7fda801401f0 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.867+0000 7fda87800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fda800b3440 con 0x7fda8014ed70 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda7fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda801401f0 0x7fda80140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda7fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda801401f0 0x7fda80140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49226/0 (socket says 172.21.15.5:49226) 2024-04-26T21:37:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda7fe00640 1 -- 172.21.15.5:0/3029497860 learned_addr learned my addr 172.21.15.5:0/3029497860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda85800640 1 --2- 172.21.15.5:0/3029497860 >> v2:172.21.15.112:3300/0 conn(0x7fda8014ed70 0x7fda80151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda7fe00640 1 -- 172.21.15.5:0/3029497860 >> v2:172.21.15.112:3300/0 conn(0x7fda8014ed70 msgr2=0x7fda80151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda7fe00640 1 --2- 172.21.15.5:0/3029497860 >> v2:172.21.15.112:3300/0 conn(0x7fda8014ed70 0x7fda80151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda7fe00640 1 -- 172.21.15.5:0/3029497860 >> v1:172.21.15.112:6789/0 conn(0x7fda8006e780 legacy=0x7fda800b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.868+0000 7fda7fe00640 1 -- 172.21.15.5:0/3029497860 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda800b11b0 con 0x7fda801401f0 2024-04-26T21:37:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.869+0000 7fda7fe00640 1 --2- 172.21.15.5:0/3029497860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda80140680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda8006ed40 tx=0x7fda7002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757f8463b79d31ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.870+0000 7fda7f400640 1 -- 172.21.15.5:0/3029497860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70037070 con 0x7fda801401f0 2024-04-26T21:37:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.870+0000 7fda7f400640 1 -- 172.21.15.5:0/3029497860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda70032440 con 0x7fda801401f0 2024-04-26T21:37:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.870+0000 7fda7f400640 1 -- 172.21.15.5:0/3029497860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70032810 con 0x7fda801401f0 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.870+0000 7fda87800640 1 -- 172.21.15.5:0/3029497860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 msgr2=0x7fda80140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.870+0000 7fda87800640 1 --2- 172.21.15.5:0/3029497860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda80140680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda8006ed40 tx=0x7fda7002a1c0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.871+0000 7fda87800640 1 -- 172.21.15.5:0/3029497860 shutdown_connections 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.871+0000 7fda87800640 1 --2- 172.21.15.5:0/3029497860 >> v2:172.21.15.112:3300/0 conn(0x7fda8014ed70 0x7fda80151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.871+0000 7fda87800640 1 --2- 172.21.15.5:0/3029497860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda80140680 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.871+0000 7fda87800640 1 -- 172.21.15.5:0/3029497860 >> 172.21.15.5:0/3029497860 conn(0x7fda800b7bb0 msgr2=0x7fda800b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.871+0000 7fda87800640 1 -- 172.21.15.5:0/3029497860 shutdown_connections 2024-04-26T21:37:37.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.871+0000 7fda87800640 1 -- 172.21.15.5:0/3029497860 wait complete. 2024-04-26T21:37:37.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.872+0000 7fda87800640 1 Processor -- start 2024-04-26T21:37:37.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.872+0000 7fda87800640 1 -- start start 2024-04-26T21:37:37.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.873+0000 7fda87800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8006e780 0x7fda801dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.873+0000 7fda87800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda8009d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.873+0000 7fda87800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda8014ed70 0x7fda8009e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.873+0000 7fda87800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda800b30c0 con 0x7fda801401f0 2024-04-26T21:37:37.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.873+0000 7fda87800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fda80140bc0 con 0x7fda8014ed70 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.873+0000 7fda87800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fda800b4090 con 0x7fda8006e780 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda8009d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda8009d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49232/0 (socket says 172.21.15.5:49232) 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 -- 172.21.15.5:0/1627446819 learned_addr learned my addr 172.21.15.5:0/1627446819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda85800640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda8014ed70 0x7fda8009e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda84e00640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8006e780 0x7fda801dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 -- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8006e780 msgr2=0x7fda801dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8006e780 0x7fda801dfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 -- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda8014ed70 msgr2=0x7fda8009e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda8014ed70 0x7fda8009e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 -- 172.21.15.5:0/1627446819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda80142bb0 con 0x7fda801401f0 2024-04-26T21:37:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.874+0000 7fda7fe00640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda8009d010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda70009960 tx=0x7fda700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.875+0000 7fda7cc00640 1 -- 172.21.15.5:0/1627446819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70037040 con 0x7fda801401f0 2024-04-26T21:37:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.875+0000 7fda7cc00640 1 -- 172.21.15.5:0/1627446819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda70004250 con 0x7fda801401f0 2024-04-26T21:37:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.875+0000 7fda7cc00640 1 -- 172.21.15.5:0/1627446819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70003610 con 0x7fda801401f0 2024-04-26T21:37:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.875+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda801dff80 con 0x7fda801401f0 2024-04-26T21:37:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.875+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda8009d550 con 0x7fda801401f0 2024-04-26T21:37:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.876+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda80075db0 con 0x7fda801401f0 2024-04-26T21:37:37.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.877+0000 7fda7cc00640 1 -- 172.21.15.5:0/1627446819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda700037b0 con 0x7fda801401f0 2024-04-26T21:37:37.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.878+0000 7fda7cc00640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fda6406c8f0 0x7fda6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:37.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.878+0000 7fda7cc00640 1 -- 172.21.15.5:0/1627446819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda700acbd0 con 0x7fda801401f0 2024-04-26T21:37:37.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.879+0000 7fda84e00640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fda6406c8f0 0x7fda6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:37.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.880+0000 7fda84e00640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fda6406c8f0 0x7fda6406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda7400a730 tx=0x7fda74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:37.882+0000 7fda7cc00640 1 -- 172.21.15.5:0/1627446819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda7007acb0 con 0x7fda801401f0 2024-04-26T21:37:38.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.133+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fda80073580 con 0x7fda801401f0 2024-04-26T21:37:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.590+0000 7fda7cc00640 1 -- 172.21.15.5:0/1627446819 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fda7007a5b0 con 0x7fda801401f0 2024-04-26T21:37:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fda6406c8f0 msgr2=0x7fda6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fda6406c8f0 0x7fda6406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda7400a730 tx=0x7fda74008040 comp rx=0 tx=0).stop 2024-04-26T21:37:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 msgr2=0x7fda8009d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda8009d010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fda70009960 tx=0x7fda700046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 shutdown_connections 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda8014ed70 0x7fda8009e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fda6406c8f0 0x7fda6406edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda801401f0 0x7fda8009d010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 --2- 172.21.15.5:0/1627446819 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda8006e780 0x7fda801dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 >> 172.21.15.5:0/1627446819 conn(0x7fda800b7bb0 msgr2=0x7fda801447c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 shutdown_connections 2024-04-26T21:37:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.594+0000 7fda87800640 1 -- 172.21.15.5:0/1627446819 wait complete. 2024-04-26T21:37:38.615 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-26T21:37:38.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T21:37:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.831+0000 7f7cccc00640 1 Processor -- start 2024-04-26T21:37:38.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.831+0000 7f7cccc00640 1 -- start start 2024-04-26T21:37:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.832+0000 7f7cccc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cc80b69b0 0x7f7cc8148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cccc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cc81421a0 0x7f7cc81425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cccc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc80b6d90 con 0x7f7cc80b87d0 2024-04-26T21:37:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cccc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc80b8c20 con 0x7f7cc80b69b0 2024-04-26T21:37:38.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cccc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc81487d0 con 0x7f7cc81421a0 2024-04-26T21:37:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cc7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cc80b69b0 0x7f7cc8148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cc7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cc80b69b0 0x7f7cc8148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49234/0 (socket says 172.21.15.5:49234) 2024-04-26T21:37:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cc7400640 1 -- 172.21.15.5:0/1536148718 learned_addr learned my addr 172.21.15.5:0/1536148718 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:38.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.833+0000 7f7cc7e00640 1 --2- 172.21.15.5:0/1536148718 >> v2:172.21.15.112:3300/0 conn(0x7f7cc81421a0 0x7f7cc81425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.834+0000 7f7cc7400640 1 -- 172.21.15.5:0/1536148718 >> v2:172.21.15.112:3300/0 conn(0x7f7cc81421a0 msgr2=0x7f7cc81425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.834+0000 7f7cc7400640 1 --2- 172.21.15.5:0/1536148718 >> v2:172.21.15.112:3300/0 conn(0x7f7cc81421a0 0x7f7cc81425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.834+0000 7f7cc7400640 1 -- 172.21.15.5:0/1536148718 >> v1:172.21.15.112:6789/0 conn(0x7f7cc80b87d0 legacy=0x7f7cc80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.834+0000 7f7cc7400640 1 -- 172.21.15.5:0/1536148718 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8148ab0 con 0x7f7cc80b69b0 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.835+0000 7f7cc7400640 1 --2- 172.21.15.5:0/1536148718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80b69b0 0x7f7cc8148fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7cc806c400 tx=0x7f7cb802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42da1fb271468a9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.835+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1536148718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8036070 con 0x7f7cc80b69b0 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.835+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1536148718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb8031600 con 0x7f7cc80b69b0 2024-04-26T21:37:38.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.835+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1536148718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80319d0 con 0x7f7cc80b69b0 2024-04-26T21:37:38.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 -- 172.21.15.5:0/1536148718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80b69b0 msgr2=0x7f7cc8148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1536148718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80b69b0 0x7f7cc8148fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7cc806c400 tx=0x7f7cb802a6f0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 -- 172.21.15.5:0/1536148718 shutdown_connections 2024-04-26T21:37:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1536148718 >> v2:172.21.15.112:3300/0 conn(0x7f7cc81421a0 0x7f7cc81425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1536148718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc80b69b0 0x7f7cc8148fd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 -- 172.21.15.5:0/1536148718 >> 172.21.15.5:0/1536148718 conn(0x7f7cc80bde50 msgr2=0x7f7cc80be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 -- 172.21.15.5:0/1536148718 shutdown_connections 2024-04-26T21:37:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.836+0000 7f7cccc00640 1 -- 172.21.15.5:0/1536148718 wait complete. 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.838+0000 7f7cccc00640 1 Processor -- start 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.838+0000 7f7cccc00640 1 -- start start 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.838+0000 7f7cccc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cc80b69b0 0x7f7cc80ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cccc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc80b87d0 0x7f7cc81dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cccc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc81421a0 0x7f7cc81dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cccc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc80ba5a0 con 0x7f7cc81421a0 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cccc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8142b10 con 0x7f7cc80b87d0 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cccc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc80ba720 con 0x7f7cc80b69b0 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc81421a0 0x7f7cc81dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc81421a0 0x7f7cc81dde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49242/0 (socket says 172.21.15.5:49242) 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 -- 172.21.15.5:0/1582827041 learned_addr learned my addr 172.21.15.5:0/1582827041 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cbea00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc80b87d0 0x7f7cc81dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7400640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cc80b69b0 0x7f7cc80ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 -- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cc80b69b0 msgr2=0x7f7cc80ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cc80b69b0 0x7f7cc80ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 -- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc80b87d0 msgr2=0x7f7cc81dd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc80b87d0 0x7f7cc81dd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7e00640 1 -- 172.21.15.5:0/1582827041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc81454a0 con 0x7f7cc81421a0 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.839+0000 7f7cc7400640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cc80b69b0 0x7f7cc80ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.840+0000 7f7cc7e00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc81421a0 0x7f7cc81dde10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000d5d0 tx=0x7f7cc000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.840+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1582827041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00125f0 con 0x7f7cc81421a0 2024-04-26T21:37:38.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.840+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1582827041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc0019070 con 0x7f7cc81421a0 2024-04-26T21:37:38.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.840+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1582827041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00129f0 con 0x7f7cc81421a0 2024-04-26T21:37:38.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.840+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc80ac2c0 con 0x7f7cc81421a0 2024-04-26T21:37:38.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.840+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc8145700 con 0x7f7cc81421a0 2024-04-26T21:37:38.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.842+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc8075db0 con 0x7f7cc81421a0 2024-04-26T21:37:38.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.843+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1582827041 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7cc0012b90 con 0x7f7cc81421a0 2024-04-26T21:37:38.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.844+0000 7f7cbfe00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7ca406c8f0 0x7f7ca406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.844+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1582827041 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7cc008c310 con 0x7f7cc81421a0 2024-04-26T21:37:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.844+0000 7f7cc7400640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7ca406c8f0 0x7f7ca406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.845+0000 7f7cc7400640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7ca406c8f0 0x7f7ca406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8033000 tx=0x7f7cb8009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:38.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:38.848+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1582827041 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7cc005a370 con 0x7f7cc81421a0 2024-04-26T21:37:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.094+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7cc80bdc60 con 0x7f7cc81421a0 2024-04-26T21:37:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.594+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1582827041 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f7cc0060030 con 0x7f7cc81421a0 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7ca406c8f0 msgr2=0x7f7ca406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7ca406c8f0 0x7f7ca406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8033000 tx=0x7f7cb8009000 comp rx=0 tx=0).stop 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc81421a0 msgr2=0x7f7cc81dde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc81421a0 0x7f7cc81dde10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000d5d0 tx=0x7f7cc000da90 comp rx=0 tx=0).stop 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 shutdown_connections 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7ca406c8f0 0x7f7ca406edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc81421a0 0x7f7cc81dde10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cc80b87d0 0x7f7cc81dd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 --2- 172.21.15.5:0/1582827041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7cc80b69b0 0x7f7cc80ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.597+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 >> 172.21.15.5:0/1582827041 conn(0x7f7cc80bde50 msgr2=0x7f7cc80be230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.598+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 shutdown_connections 2024-04-26T21:37:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.598+0000 7f7cccc00640 1 -- 172.21.15.5:0/1582827041 wait complete. 2024-04-26T21:37:39.623 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T21:37:39.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:37:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.827+0000 7f0083e00640 1 Processor -- start 2024-04-26T21:37:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.827+0000 7f0083e00640 1 -- start start 2024-04-26T21:37:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.828+0000 7f0083e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00840b3360 0x7f0084146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.828+0000 7f0083e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f0084073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.828+0000 7f0083e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0084146f80 0x7f0084073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.828+0000 7f0083e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f00840b43e0 con 0x7f0084146f80 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.828+0000 7f0083e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0084071c20 con 0x7f00840b3360 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.828+0000 7f0083e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0084070bc0 con 0x7f00840b5fc0 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0084146f80 0x7f0084073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0084146f80 0x7f0084073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49246/0 (socket says 172.21.15.5:49246) 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 -- 172.21.15.5:0/3288577726 learned_addr learned my addr 172.21.15.5:0/3288577726 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0082a00640 1 --2- 172.21.15.5:0/3288577726 >> v2:172.21.15.112:3300/0 conn(0x7f00840b3360 0x7f0084146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0082000640 1 --2- 172.21.15.5:0/3288577726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f0084073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 -- 172.21.15.5:0/3288577726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 msgr2=0x7f0084073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 --2- 172.21.15.5:0/3288577726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f0084073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 -- 172.21.15.5:0/3288577726 >> v2:172.21.15.112:3300/0 conn(0x7f00840b3360 msgr2=0x7f0084146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 --2- 172.21.15.5:0/3288577726 >> v2:172.21.15.112:3300/0 conn(0x7f00840b3360 0x7f0084146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.829+0000 7f0083400640 1 -- 172.21.15.5:0/3288577726 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00840b3740 con 0x7f0084146f80 2024-04-26T21:37:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.830+0000 7f0083400640 1 --2- 172.21.15.5:0/3288577726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0084146f80 0x7f0084073b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f007c009e80 tx=0x7f007c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9663d1a70d257514 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.831+0000 7f0081600640 1 -- 172.21.15.5:0/3288577726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c036070 con 0x7f0084146f80 2024-04-26T21:37:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.831+0000 7f0081600640 1 -- 172.21.15.5:0/3288577726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f007c031600 con 0x7f0084146f80 2024-04-26T21:37:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.831+0000 7f0081600640 1 -- 172.21.15.5:0/3288577726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c0319d0 con 0x7f0084146f80 2024-04-26T21:37:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.831+0000 7f0083e00640 1 -- 172.21.15.5:0/3288577726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0084146f80 msgr2=0x7f0084073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.831+0000 7f0083e00640 1 --2- 172.21.15.5:0/3288577726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0084146f80 0x7f0084073b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f007c009e80 tx=0x7f007c02a660 comp rx=0 tx=0).stop 2024-04-26T21:37:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.832+0000 7f0083e00640 1 -- 172.21.15.5:0/3288577726 shutdown_connections 2024-04-26T21:37:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.832+0000 7f0083e00640 1 --2- 172.21.15.5:0/3288577726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0084146f80 0x7f0084073b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.832+0000 7f0083e00640 1 --2- 172.21.15.5:0/3288577726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f0084073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.832+0000 7f0083e00640 1 --2- 172.21.15.5:0/3288577726 >> v2:172.21.15.112:3300/0 conn(0x7f00840b3360 0x7f0084146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.832+0000 7f0083e00640 1 -- 172.21.15.5:0/3288577726 >> 172.21.15.5:0/3288577726 conn(0x7f008406c300 msgr2=0x7f008406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.832+0000 7f0083e00640 1 -- 172.21.15.5:0/3288577726 shutdown_connections 2024-04-26T21:37:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.832+0000 7f0083e00640 1 -- 172.21.15.5:0/3288577726 wait complete. 2024-04-26T21:37:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.834+0000 7f0083e00640 1 Processor -- start 2024-04-26T21:37:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.834+0000 7f0083e00640 1 -- start start 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0083e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00840b3360 0x7f00841dde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0083e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f00841de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0083e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0084146f80 0x7f0084140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0083e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f008406ebc0 con 0x7f00840b3360 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0083e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0084146520 con 0x7f0084146f80 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0083e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f00840b3d10 con 0x7f00840b5fc0 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0082a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00840b3360 0x7f00841dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0082a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00840b3360 0x7f00841dde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49258/0 (socket says 172.21.15.5:49258) 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.835+0000 7f0082a00640 1 -- 172.21.15.5:0/4141212720 learned_addr learned my addr 172.21.15.5:0/4141212720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0083400640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0084146f80 0x7f0084140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082000640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f00841de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082a00640 1 -- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 msgr2=0x7f00841de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082a00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f00841de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082a00640 1 -- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0084146f80 msgr2=0x7f0084140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082a00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0084146f80 0x7f0084140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082a00640 1 -- 172.21.15.5:0/4141212720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00841de8e0 con 0x7f00840b3360 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082000640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f00841de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0082a00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00840b3360 0x7f00841dde60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f007400d830 tx=0x7f007400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f007aa00640 1 -- 172.21.15.5:0/4141212720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007400b6c0 con 0x7f00840b3360 2024-04-26T21:37:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f007aa00640 1 -- 172.21.15.5:0/4141212720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0074019070 con 0x7f00840b3360 2024-04-26T21:37:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f007aa00640 1 -- 172.21.15.5:0/4141212720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007400ba80 con 0x7f00840b3360 2024-04-26T21:37:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.836+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00841425b0 con 0x7f00840b3360 2024-04-26T21:37:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.837+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0084143bc0 con 0x7f00840b3360 2024-04-26T21:37:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.838+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00840af680 con 0x7f00840b3360 2024-04-26T21:37:39.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.838+0000 7f007aa00640 1 -- 172.21.15.5:0/4141212720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f007401e460 con 0x7f00840b3360 2024-04-26T21:37:39.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.839+0000 7f007aa00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f006406c8f0 0x7f006406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:39.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.839+0000 7f007aa00640 1 -- 172.21.15.5:0/4141212720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f007408c580 con 0x7f00840b3360 2024-04-26T21:37:39.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.840+0000 7f0082000640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f006406c8f0 0x7f006406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:39.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.841+0000 7f0082000640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f006406c8f0 0x7f006406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0084140110 tx=0x7f0070008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:39.844+0000 7f007aa00640 1 -- 172.21.15.5:0/4141212720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f00840af680 con 0x7f00840b3360 2024-04-26T21:37:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.090+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0084072fb0 con 0x7f00840b3360 2024-04-26T21:37:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.092+0000 7f007aa00640 1 -- 172.21.15.5:0/4141212720 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7f0084072fb0 con 0x7f00840b3360 2024-04-26T21:37:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:40.092 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:39.095752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T21:37:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-04-26T21:37:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f006406c8f0 msgr2=0x7f006406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f006406c8f0 0x7f006406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0084140110 tx=0x7f0070008040 comp rx=0 tx=0).stop 2024-04-26T21:37:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00840b3360 msgr2=0x7f00841dde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00840b3360 0x7f00841dde60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f007400d830 tx=0x7f007400dcf0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 shutdown_connections 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0084146f80 0x7f0084140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00840b5fc0 0x7f00841de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f006406c8f0 0x7f006406edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 --2- 172.21.15.5:0/4141212720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00840b3360 0x7f00841dde60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.094+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 >> 172.21.15.5:0/4141212720 conn(0x7f008406c300 msgr2=0x7f00840aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.095+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 shutdown_connections 2024-04-26T21:37:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.095+0000 7f0083e00640 1 -- 172.21.15.5:0/4141212720 wait complete. 2024-04-26T21:37:40.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.313+0000 7fd893200640 1 Processor -- start 2024-04-26T21:37:40.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.313+0000 7fd893200640 1 -- start start 2024-04-26T21:37:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.314+0000 7fd893200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd894142a20 0x7fd8940b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.314+0000 7fd893200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894148600 0x7fd894148a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.314+0000 7fd893200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8940bb260 con 0x7fd8940bae80 2024-04-26T21:37:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.314+0000 7fd893200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd894148f70 con 0x7fd894142a20 2024-04-26T21:37:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.314+0000 7fd893200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd8940b6270 con 0x7fd894148600 2024-04-26T21:37:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.315+0000 7fd891400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd894142a20 0x7fd8940b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.315+0000 7fd891400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd894142a20 0x7fd8940b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53846/0 (socket says 172.21.15.5:53846) 2024-04-26T21:37:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.315+0000 7fd891400640 1 -- 172.21.15.5:0/3135118124 learned_addr learned my addr 172.21.15.5:0/3135118124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.315+0000 7fd892800640 1 --2- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894148600 0x7fd894148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.316+0000 7fd891400640 1 -- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894148600 msgr2=0x7fd894148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.316+0000 7fd891400640 1 --2- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894148600 0x7fd894148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.316+0000 7fd891400640 1 -- 172.21.15.5:0/3135118124 >> v1:172.21.15.112:6789/0 conn(0x7fd8940bae80 legacy=0x7fd894142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.316+0000 7fd891400640 1 -- 172.21.15.5:0/3135118124 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8940b6550 con 0x7fd894142a20 2024-04-26T21:37:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.316+0000 7fd892800640 1 --2- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894148600 0x7fd894148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:37:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.317+0000 7fd891400640 1 --2- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd894142a20 0x7fd8940b57d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd884009870 tx=0x7fd88402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155b46e261a8bc88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.318+0000 7fd890a00640 1 -- 172.21.15.5:0/3135118124 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884037070 con 0x7fd894142a20 2024-04-26T21:37:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.318+0000 7fd890a00640 1 -- 172.21.15.5:0/3135118124 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd884032440 con 0x7fd894142a20 2024-04-26T21:37:40.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.318+0000 7fd890a00640 1 -- 172.21.15.5:0/3135118124 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884032810 con 0x7fd894142a20 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.318+0000 7fd893200640 1 -- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd894142a20 msgr2=0x7fd8940b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.318+0000 7fd893200640 1 --2- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd894142a20 0x7fd8940b57d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd884009870 tx=0x7fd88402a1c0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.319+0000 7fd893200640 1 -- 172.21.15.5:0/3135118124 shutdown_connections 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.319+0000 7fd893200640 1 --2- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894148600 0x7fd894148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.319+0000 7fd893200640 1 --2- 172.21.15.5:0/3135118124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd894142a20 0x7fd8940b57d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.319+0000 7fd893200640 1 -- 172.21.15.5:0/3135118124 >> 172.21.15.5:0/3135118124 conn(0x7fd8940684b0 msgr2=0x7fd8940688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.319+0000 7fd893200640 1 -- 172.21.15.5:0/3135118124 shutdown_connections 2024-04-26T21:37:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.319+0000 7fd893200640 1 -- 172.21.15.5:0/3135118124 wait complete. 2024-04-26T21:37:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.320+0000 7fd893200640 1 Processor -- start 2024-04-26T21:37:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.320+0000 7fd893200640 1 -- start start 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.321+0000 7fd893200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940bae80 0x7fd89413b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.321+0000 7fd893200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894142a20 0x7fd894139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.321+0000 7fd893200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd894148600 0x7fd894139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.321+0000 7fd893200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940ba310 con 0x7fd894148600 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.321+0000 7fd893200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940ba190 con 0x7fd8940bae80 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.321+0000 7fd893200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd894152e10 con 0x7fd894142a20 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.321+0000 7fd892800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd894148600 0x7fd894139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd894148600 0x7fd894139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49266/0 (socket says 172.21.15.5:49266) 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 -- 172.21.15.5:0/1965529246 learned_addr learned my addr 172.21.15.5:0/1965529246 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd891400640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894142a20 0x7fd894139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd891e00640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940bae80 0x7fd89413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 -- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894142a20 msgr2=0x7fd894139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894142a20 0x7fd894139340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 -- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940bae80 msgr2=0x7fd89413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940bae80 0x7fd89413b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 -- 172.21.15.5:0/1965529246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89413acf0 con 0x7fd894148600 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.322+0000 7fd892800640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd894148600 0x7fd894139880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00efc0 tx=0x7fd88c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.323+0000 7fd88a000640 1 -- 172.21.15.5:0/1965529246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c018030 con 0x7fd894148600 2024-04-26T21:37:40.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.323+0000 7fd88a000640 1 -- 172.21.15.5:0/1965529246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c00cdf0 con 0x7fd894148600 2024-04-26T21:37:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.323+0000 7fd88a000640 1 -- 172.21.15.5:0/1965529246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c003bb0 con 0x7fd894148600 2024-04-26T21:37:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.323+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89413afd0 con 0x7fd894148600 2024-04-26T21:37:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.323+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89413f0e0 con 0x7fd894148600 2024-04-26T21:37:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.324+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89413f2e0 con 0x7fd894148600 2024-04-26T21:37:40.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.325+0000 7fd88a000640 1 -- 172.21.15.5:0/1965529246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd88c01b070 con 0x7fd894148600 2024-04-26T21:37:40.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.326+0000 7fd88a000640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd87006c8f0 0x7fd87006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.327+0000 7fd88a000640 1 -- 172.21.15.5:0/1965529246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd88c08c8c0 con 0x7fd894148600 2024-04-26T21:37:40.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.327+0000 7fd891e00640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd87006c8f0 0x7fd87006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.328+0000 7fd891e00640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd87006c8f0 0x7fd87006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd89414c630 tx=0x7fd87c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:40.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.331+0000 7fd88a000640 1 -- 172.21.15.5:0/1965529246 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd88c010040 con 0x7fd894148600 2024-04-26T21:37:40.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.539+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd89413dd90 con 0x7fd894148600 2024-04-26T21:37:40.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.542+0000 7fd88a000640 1 -- 172.21.15.5:0/1965529246 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7fd88c05a350 con 0x7fd894148600 2024-04-26T21:37:40.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:40.543 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:40.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd87006c8f0 msgr2=0x7fd87006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd87006c8f0 0x7fd87006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd89414c630 tx=0x7fd87c009040 comp rx=0 tx=0).stop 2024-04-26T21:37:40.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd894148600 msgr2=0x7fd894139880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd894148600 0x7fd894139880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00efc0 tx=0x7fd88c00c490 comp rx=0 tx=0).stop 2024-04-26T21:37:40.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 shutdown_connections 2024-04-26T21:37:40.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd87006c8f0 0x7fd87006edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd894148600 0x7fd894139880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd894142a20 0x7fd894139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 --2- 172.21.15.5:0/1965529246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940bae80 0x7fd89413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 >> 172.21.15.5:0/1965529246 conn(0x7fd8940684b0 msgr2=0x7fd894146ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 shutdown_connections 2024-04-26T21:37:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.545+0000 7fd893200640 1 -- 172.21.15.5:0/1965529246 wait complete. 2024-04-26T21:37:40.564 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T21:37:40.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:37:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.774+0000 7ffbc7200640 1 Processor -- start 2024-04-26T21:37:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.774+0000 7ffbc7200640 1 -- start start 2024-04-26T21:37:40.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.775+0000 7ffbc7200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffbc8142a20 0x7ffbc80b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.775+0000 7ffbc7200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc80bb260 con 0x7ffbc8148600 2024-04-26T21:37:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.775+0000 7ffbc7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc80b6270 con 0x7ffbc80bae80 2024-04-26T21:37:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.775+0000 7ffbc7200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc80b6550 con 0x7ffbc8142a20 2024-04-26T21:37:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.776+0000 7ffbc6800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffbc8148600 0x7ffbc8148a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56116/0 (socket says 172.21.15.5:56116) 2024-04-26T21:37:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.776+0000 7ffbc6800640 1 -- 172.21.15.5:0/942358108 learned_addr learned my addr 172.21.15.5:0/942358108 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.776+0000 7ffbc5400640 1 --2- 172.21.15.5:0/942358108 >> v2:172.21.15.112:3300/0 conn(0x7ffbc8142a20 0x7ffbc80b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.776+0000 7ffbc4a00640 1 -- 172.21.15.5:0/942358108 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492068866 0 0) 0x7ffbc80bb260 con 0x7ffbc8148600 2024-04-26T21:37:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.776+0000 7ffbc4a00640 1 -- 172.21.15.5:0/942358108 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbac003520 con 0x7ffbc8148600 2024-04-26T21:37:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.777+0000 7ffbc4a00640 1 -- 172.21.15.5:0/942358108 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3763856734 0 0) 0x7ffbac003520 con 0x7ffbc8148600 2024-04-26T21:37:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.777+0000 7ffbc5400640 1 -- 172.21.15.5:0/942358108 >> v1:172.21.15.112:6789/0 conn(0x7ffbc80bae80 legacy=0x7ffbc8142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.777+0000 7ffbc5400640 1 -- 172.21.15.5:0/942358108 >> v1:172.21.15.5:6789/0 conn(0x7ffbc8148600 legacy=0x7ffbc8148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.777+0000 7ffbc5400640 1 -- 172.21.15.5:0/942358108 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc80b6830 con 0x7ffbc8142a20 2024-04-26T21:37:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.778+0000 7ffbc5400640 1 --2- 172.21.15.5:0/942358108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc8142a20 0x7ffbc80b57d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d90 tx=0x7ffbb802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9ec14c62cf5ace server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc4a00640 1 -- 172.21.15.5:0/942358108 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0001670 con 0x7ffbc8142a20 2024-04-26T21:37:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc4a00640 1 -- 172.21.15.5:0/942358108 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8007540 con 0x7ffbc8142a20 2024-04-26T21:37:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc4a00640 1 -- 172.21.15.5:0/942358108 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8007910 con 0x7ffbc8142a20 2024-04-26T21:37:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc7200640 1 -- 172.21.15.5:0/942358108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc8142a20 msgr2=0x7ffbc80b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc7200640 1 --2- 172.21.15.5:0/942358108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc8142a20 0x7ffbc80b57d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d90 tx=0x7ffbb802a5f0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc7200640 1 -- 172.21.15.5:0/942358108 shutdown_connections 2024-04-26T21:37:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc7200640 1 --2- 172.21.15.5:0/942358108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc8142a20 0x7ffbc80b57d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc7200640 1 -- 172.21.15.5:0/942358108 >> 172.21.15.5:0/942358108 conn(0x7ffbc80684b0 msgr2=0x7ffbc80688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc7200640 1 -- 172.21.15.5:0/942358108 shutdown_connections 2024-04-26T21:37:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.779+0000 7ffbc7200640 1 -- 172.21.15.5:0/942358108 wait complete. 2024-04-26T21:37:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.781+0000 7ffbc7200640 1 Processor -- start 2024-04-26T21:37:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.781+0000 7ffbc7200640 1 -- start start 2024-04-26T21:37:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.782+0000 7ffbc7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80bae80 0x7ffbc813af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.782+0000 7ffbc7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc8142a20 0x7ffbc813bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.782+0000 7ffbc7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbc8148600 0x7ffbc8145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.782+0000 7ffbc7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8153fa0 con 0x7ffbc8148600 2024-04-26T21:37:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.782+0000 7ffbc7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc8153e20 con 0x7ffbc80bae80 2024-04-26T21:37:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.782+0000 7ffbc7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc8154120 con 0x7ffbc8142a20 2024-04-26T21:37:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc8142a20 0x7ffbc813bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc8142a20 0x7ffbc813bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:48832/0 (socket says 172.21.15.5:48832) 2024-04-26T21:37:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc5400640 1 -- 172.21.15.5:0/515326086 learned_addr learned my addr 172.21.15.5:0/515326086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc6800640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbc8148600 0x7ffbc8145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc5e00640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80bae80 0x7ffbc813af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc6800640 1 -- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc8142a20 msgr2=0x7ffbc813bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc6800640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc8142a20 0x7ffbc813bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc6800640 1 -- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80bae80 msgr2=0x7ffbc813af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc6800640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80bae80 0x7ffbc813af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc6800640 1 -- 172.21.15.5:0/515326086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc813c520 con 0x7ffbc8148600 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.783+0000 7ffbc5e00640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80bae80 0x7ffbc813af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.784+0000 7ffbc6800640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbc8148600 0x7ffbc8145450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0001380 tx=0x7ffbc000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.784+0000 7ffbbe000640 1 -- 172.21.15.5:0/515326086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0017070 con 0x7ffbc8148600 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.784+0000 7ffbbe000640 1 -- 172.21.15.5:0/515326086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc0005d00 con 0x7ffbc8148600 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.784+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc813b5a0 con 0x7ffbc8148600 2024-04-26T21:37:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.784+0000 7ffbbe000640 1 -- 172.21.15.5:0/515326086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0007310 con 0x7ffbc8148600 2024-04-26T21:37:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.784+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc813eb80 con 0x7ffbc8148600 2024-04-26T21:37:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.785+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc8069ae0 con 0x7ffbc8148600 2024-04-26T21:37:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.786+0000 7ffbbe000640 1 -- 172.21.15.5:0/515326086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffbc001a070 con 0x7ffbc8148600 2024-04-26T21:37:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.787+0000 7ffbbe000640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffba406c920 0x7ffba406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.787+0000 7ffbbe000640 1 -- 172.21.15.5:0/515326086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffbc008b230 con 0x7ffbc8148600 2024-04-26T21:37:40.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.788+0000 7ffbc5e00640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffba406c920 0x7ffba406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:40.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.789+0000 7ffbc5e00640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffba406c920 0x7ffba406ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0007fd0 tx=0x7ffbb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.792+0000 7ffbbe000640 1 -- 172.21.15.5:0/515326086 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffbc8069ae0 con 0x7ffbc8148600 2024-04-26T21:37:40.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:40.992+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbc8075db0 con 0x7ffba406c920 2024-04-26T21:37:41.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.024+0000 7ffbbe000640 1 -- 172.21.15.5:0/515326086 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332570 (secure 0 0 0) 0x7ffbc8075db0 con 0x7ffba406c920 2024-04-26T21:37:41.027 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T21:37:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.031+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffba406c920 msgr2=0x7ffba406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.031+0000 7ffbc7200640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffba406c920 0x7ffba406ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0007fd0 tx=0x7ffbb0009040 comp rx=0 tx=0).stop 2024-04-26T21:37:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.031+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbc8148600 msgr2=0x7ffbc8145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.031+0000 7ffbc7200640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbc8148600 0x7ffbc8145450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0001380 tx=0x7ffbc000c8e0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 shutdown_connections 2024-04-26T21:37:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffba406c920 0x7ffba406ede0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbc8148600 0x7ffbc8145450 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbc8142a20 0x7ffbc813bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 --2- 172.21.15.5:0/515326086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbc80bae80 0x7ffbc813af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 >> 172.21.15.5:0/515326086 conn(0x7ffbc80684b0 msgr2=0x7ffbc81420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 shutdown_connections 2024-04-26T21:37:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.032+0000 7ffbc7200640 1 -- 172.21.15.5:0/515326086 wait complete. 2024-04-26T21:37:41.050 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-26T21:37:39.458453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227704,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747016,"statfs":{"total":773094113280,"available":772860944384,"internally_reserved":0,"allocated":3284992,"data_stored":1991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":229756468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005491"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007792+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T21:37:23.007792+0000","last_peered":"2024-04-26T21:37:23.007792+0000","last_clean":"2024-04-26T21:37:23.007792+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T21:37:23.007792+0000","last_undegraded":"2024-04-26T21:37:23.007792+0000","last_fullsized":"2024-04-26T21:37:23.007792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:32.834699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504581+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T21:37:22.504581+0000","last_peered":"2024-04-26T21:37:22.504581+0000","last_clean":"2024-04-26T21:37:22.504581+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T21:37:22.504581+0000","last_undegraded":"2024-04-26T21:37:22.504581+0000","last_fullsized":"2024-04-26T21:37:22.504581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502119+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T21:37:22.502119+0000","last_peered":"2024-04-26T21:37:22.502119+0000","last_clean":"2024-04-26T21:37:22.502119+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T21:37:22.502119+0000","last_undegraded":"2024-04-26T21:37:22.502119+0000","last_fullsized":"2024-04-26T21:37:22.502119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505039+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T21:37:22.505039+0000","last_peered":"2024-04-26T21:37:22.505039+0000","last_clean":"2024-04-26T21:37:22.505039+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T21:37:22.505039+0000","last_undegraded":"2024-04-26T21:37:22.505039+0000","last_fullsized":"2024-04-26T21:37:22.505039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006872+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T21:37:23.006872+0000","last_peered":"2024-04-26T21:37:23.006872+0000","last_clean":"2024-04-26T21:37:23.006872+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T21:37:23.006872+0000","last_undegraded":"2024-04-26T21:37:23.006872+0000","last_fullsized":"2024-04-26T21:37:23.006872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897958+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T21:37:22.897958+0000","last_peered":"2024-04-26T21:37:22.897958+0000","last_clean":"2024-04-26T21:37:22.897958+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T21:37:22.897958+0000","last_undegraded":"2024-04-26T21:37:22.897958+0000","last_fullsized":"2024-04-26T21:37:22.897958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009318+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T21:37:23.009318+0000","last_peered":"2024-04-26T21:37:23.009318+0000","last_clean":"2024-04-26T21:37:23.009318+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T21:37:23.009318+0000","last_undegraded":"2024-04-26T21:37:23.009318+0000","last_fullsized":"2024-04-26T21:37:23.009318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835366+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T21:37:22.835366+0000","last_peered":"2024-04-26T21:37:22.835366+0000","last_clean":"2024-04-26T21:37:22.835366+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T21:37:22.835366+0000","last_undegraded":"2024-04-26T21:37:22.835366+0000","last_fullsized":"2024-04-26T21:37:22.835366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897760+0000","last_change":"2024-04-26T21:37:21.501976+0000","last_active":"2024-04-26T21:37:22.897760+0000","last_peered":"2024-04-26T21:37:22.897760+0000","last_clean":"2024-04-26T21:37:22.897760+0000","last_became_active":"2024-04-26T21:37:21.501426+0000","last_became_peered":"2024-04-26T21:37:21.501426+0000","last_unstale":"2024-04-26T21:37:22.897760+0000","last_undegraded":"2024-04-26T21:37:22.897760+0000","last_fullsized":"2024-04-26T21:37:22.897760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:44.895996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008636+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T21:37:23.008636+0000","last_peered":"2024-04-26T21:37:23.008636+0000","last_clean":"2024-04-26T21:37:23.008636+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T21:37:23.008636+0000","last_undegraded":"2024-04-26T21:37:23.008636+0000","last_fullsized":"2024-04-26T21:37:23.008636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835679+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T21:37:22.835679+0000","last_peered":"2024-04-26T21:37:22.835679+0000","last_clean":"2024-04-26T21:37:22.835679+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T21:37:22.835679+0000","last_undegraded":"2024-04-26T21:37:22.835679+0000","last_fullsized":"2024-04-26T21:37:22.835679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897630+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T21:37:22.897630+0000","last_peered":"2024-04-26T21:37:22.897630+0000","last_clean":"2024-04-26T21:37:22.897630+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T21:37:22.897630+0000","last_undegraded":"2024-04-26T21:37:22.897630+0000","last_fullsized":"2024-04-26T21:37:22.897630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503627+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T21:37:22.503627+0000","last_peered":"2024-04-26T21:37:22.503627+0000","last_clean":"2024-04-26T21:37:22.503627+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T21:37:22.503627+0000","last_undegraded":"2024-04-26T21:37:22.503627+0000","last_fullsized":"2024-04-26T21:37:22.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008824+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T21:37:23.008824+0000","last_peered":"2024-04-26T21:37:23.008824+0000","last_clean":"2024-04-26T21:37:23.008824+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T21:37:23.008824+0000","last_undegraded":"2024-04-26T21:37:23.008824+0000","last_fullsized":"2024-04-26T21:37:23.008824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898971+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T21:37:22.898971+0000","last_peered":"2024-04-26T21:37:22.898971+0000","last_clean":"2024-04-26T21:37:22.898971+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T21:37:22.898971+0000","last_undegraded":"2024-04-26T21:37:22.898971+0000","last_fullsized":"2024-04-26T21:37:22.898971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503070+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T21:37:22.503070+0000","last_peered":"2024-04-26T21:37:22.503070+0000","last_clean":"2024-04-26T21:37:22.503070+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T21:37:22.503070+0000","last_undegraded":"2024-04-26T21:37:22.503070+0000","last_fullsized":"2024-04-26T21:37:22.503070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008916+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T21:37:23.008916+0000","last_peered":"2024-04-26T21:37:23.008916+0000","last_clean":"2024-04-26T21:37:23.008916+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T21:37:23.008916+0000","last_undegraded":"2024-04-26T21:37:23.008916+0000","last_fullsized":"2024-04-26T21:37:23.008916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898299+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T21:37:22.898299+0000","last_peered":"2024-04-26T21:37:22.898299+0000","last_clean":"2024-04-26T21:37:22.898299+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T21:37:22.898299+0000","last_undegraded":"2024-04-26T21:37:22.898299+0000","last_fullsized":"2024-04-26T21:37:22.898299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502408+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T21:37:22.502408+0000","last_peered":"2024-04-26T21:37:22.502408+0000","last_clean":"2024-04-26T21:37:22.502408+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T21:37:22.502408+0000","last_undegraded":"2024-04-26T21:37:22.502408+0000","last_fullsized":"2024-04-26T21:37:22.502408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007771+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T21:37:23.007771+0000","last_peered":"2024-04-26T21:37:23.007771+0000","last_clean":"2024-04-26T21:37:23.007771+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T21:37:23.007771+0000","last_undegraded":"2024-04-26T21:37:23.007771+0000","last_fullsized":"2024-04-26T21:37:23.007771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009132+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T21:37:23.009132+0000","last_peered":"2024-04-26T21:37:23.009132+0000","last_clean":"2024-04-26T21:37:23.009132+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T21:37:23.009132+0000","last_undegraded":"2024-04-26T21:37:23.009132+0000","last_fullsized":"2024-04-26T21:37:23.009132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898265+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T21:37:22.898265+0000","last_peered":"2024-04-26T21:37:22.898265+0000","last_clean":"2024-04-26T21:37:22.898265+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T21:37:22.898265+0000","last_undegraded":"2024-04-26T21:37:22.898265+0000","last_fullsized":"2024-04-26T21:37:22.898265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007818+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T21:37:23.007818+0000","last_peered":"2024-04-26T21:37:23.007818+0000","last_clean":"2024-04-26T21:37:23.007818+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T21:37:23.007818+0000","last_undegraded":"2024-04-26T21:37:23.007818+0000","last_fullsized":"2024-04-26T21:37:23.007818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898858+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T21:37:22.898858+0000","last_peered":"2024-04-26T21:37:22.898858+0000","last_clean":"2024-04-26T21:37:22.898858+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T21:37:22.898858+0000","last_undegraded":"2024-04-26T21:37:22.898858+0000","last_fullsized":"2024-04-26T21:37:22.898858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007135+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T21:37:23.007135+0000","last_peered":"2024-04-26T21:37:23.007135+0000","last_clean":"2024-04-26T21:37:23.007135+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T21:37:23.007135+0000","last_undegraded":"2024-04-26T21:37:23.007135+0000","last_fullsized":"2024-04-26T21:37:23.007135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505636+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T21:37:22.505636+0000","last_peered":"2024-04-26T21:37:22.505636+0000","last_clean":"2024-04-26T21:37:22.505636+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T21:37:22.505636+0000","last_undegraded":"2024-04-26T21:37:22.505636+0000","last_fullsized":"2024-04-26T21:37:22.505636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897853+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T21:37:22.897853+0000","last_peered":"2024-04-26T21:37:22.897853+0000","last_clean":"2024-04-26T21:37:22.897853+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T21:37:22.897853+0000","last_undegraded":"2024-04-26T21:37:22.897853+0000","last_fullsized":"2024-04-26T21:37:22.897853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504219+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T21:37:22.504219+0000","last_peered":"2024-04-26T21:37:22.504219+0000","last_clean":"2024-04-26T21:37:22.504219+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T21:37:22.504219+0000","last_undegraded":"2024-04-26T21:37:22.504219+0000","last_fullsized":"2024-04-26T21:37:22.504219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009255+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T21:37:23.009255+0000","last_peered":"2024-04-26T21:37:23.009255+0000","last_clean":"2024-04-26T21:37:23.009255+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T21:37:23.009255+0000","last_undegraded":"2024-04-26T21:37:23.009255+0000","last_fullsized":"2024-04-26T21:37:23.009255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501932+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T21:37:22.501932+0000","last_peered":"2024-04-26T21:37:22.501932+0000","last_clean":"2024-04-26T21:37:22.501932+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T21:37:22.501932+0000","last_undegraded":"2024-04-26T21:37:22.501932+0000","last_fullsized":"2024-04-26T21:37:22.501932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008562+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T21:37:23.008562+0000","last_peered":"2024-04-26T21:37:23.008562+0000","last_clean":"2024-04-26T21:37:23.008562+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T21:37:23.008562+0000","last_undegraded":"2024-04-26T21:37:23.008562+0000","last_fullsized":"2024-04-26T21:37:23.008562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009625+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T21:37:23.009625+0000","last_peered":"2024-04-26T21:37:23.009625+0000","last_clean":"2024-04-26T21:37:23.009625+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T21:37:23.009625+0000","last_undegraded":"2024-04-26T21:37:23.009625+0000","last_fullsized":"2024-04-26T21:37:23.009625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006714+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T21:37:23.006714+0000","last_peered":"2024-04-26T21:37:23.006714+0000","last_clean":"2024-04-26T21:37:23.006714+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T21:37:23.006714+0000","last_undegraded":"2024-04-26T21:37:23.006714+0000","last_fullsized":"2024-04-26T21:37:23.006714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836004+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T21:37:22.836004+0000","last_peered":"2024-04-26T21:37:22.836004+0000","last_clean":"2024-04-26T21:37:22.836004+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T21:37:22.836004+0000","last_undegraded":"2024-04-26T21:37:22.836004+0000","last_fullsized":"2024-04-26T21:37:22.836004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008627+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T21:37:23.008627+0000","last_peered":"2024-04-26T21:37:23.008627+0000","last_clean":"2024-04-26T21:37:23.008627+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T21:37:23.008627+0000","last_undegraded":"2024-04-26T21:37:23.008627+0000","last_fullsized":"2024-04-26T21:37:23.008627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008859+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T21:37:23.008859+0000","last_peered":"2024-04-26T21:37:23.008859+0000","last_clean":"2024-04-26T21:37:23.008859+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T21:37:23.008859+0000","last_undegraded":"2024-04-26T21:37:23.008859+0000","last_fullsized":"2024-04-26T21:37:23.008859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898544+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T21:37:22.898544+0000","last_peered":"2024-04-26T21:37:22.898544+0000","last_clean":"2024-04-26T21:37:22.898544+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T21:37:22.898544+0000","last_undegraded":"2024-04-26T21:37:22.898544+0000","last_fullsized":"2024-04-26T21:37:22.898544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835574+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T21:37:22.835574+0000","last_peered":"2024-04-26T21:37:22.835574+0000","last_clean":"2024-04-26T21:37:22.835574+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T21:37:22.835574+0000","last_undegraded":"2024-04-26T21:37:22.835574+0000","last_fullsized":"2024-04-26T21:37:22.835574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008566+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T21:37:23.008566+0000","last_peered":"2024-04-26T21:37:23.008566+0000","last_clean":"2024-04-26T21:37:23.008566+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T21:37:23.008566+0000","last_undegraded":"2024-04-26T21:37:23.008566+0000","last_fullsized":"2024-04-26T21:37:23.008566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007854+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T21:37:23.007854+0000","last_peered":"2024-04-26T21:37:23.007854+0000","last_clean":"2024-04-26T21:37:23.007854+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T21:37:23.007854+0000","last_undegraded":"2024-04-26T21:37:23.007854+0000","last_fullsized":"2024-04-26T21:37:23.007854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505152+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T21:37:22.505152+0000","last_peered":"2024-04-26T21:37:22.505152+0000","last_clean":"2024-04-26T21:37:22.505152+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T21:37:22.505152+0000","last_undegraded":"2024-04-26T21:37:22.505152+0000","last_fullsized":"2024-04-26T21:37:22.505152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009481+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T21:37:23.009481+0000","last_peered":"2024-04-26T21:37:23.009481+0000","last_clean":"2024-04-26T21:37:23.009481+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T21:37:23.009481+0000","last_undegraded":"2024-04-26T21:37:23.009481+0000","last_fullsized":"2024-04-26T21:37:23.009481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005333+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T21:37:23.005333+0000","last_peered":"2024-04-26T21:37:23.005333+0000","last_clean":"2024-04-26T21:37:23.005333+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T21:37:23.005333+0000","last_undegraded":"2024-04-26T21:37:23.005333+0000","last_fullsized":"2024-04-26T21:37:23.005333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:03.104148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007821+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T21:37:23.007821+0000","last_peered":"2024-04-26T21:37:23.007821+0000","last_clean":"2024-04-26T21:37:23.007821+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T21:37:23.007821+0000","last_undegraded":"2024-04-26T21:37:23.007821+0000","last_fullsized":"2024-04-26T21:37:23.007821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007190+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T21:37:23.007190+0000","last_peered":"2024-04-26T21:37:23.007190+0000","last_clean":"2024-04-26T21:37:23.007190+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T21:37:23.007190+0000","last_undegraded":"2024-04-26T21:37:23.007190+0000","last_fullsized":"2024-04-26T21:37:23.007190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502972+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T21:37:22.502972+0000","last_peered":"2024-04-26T21:37:22.502972+0000","last_clean":"2024-04-26T21:37:22.502972+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T21:37:22.502972+0000","last_undegraded":"2024-04-26T21:37:22.502972+0000","last_fullsized":"2024-04-26T21:37:22.502972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835398+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T21:37:22.835398+0000","last_peered":"2024-04-26T21:37:22.835398+0000","last_clean":"2024-04-26T21:37:22.835398+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T21:37:22.835398+0000","last_undegraded":"2024-04-26T21:37:22.835398+0000","last_fullsized":"2024-04-26T21:37:22.835398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008149+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T21:37:23.008149+0000","last_peered":"2024-04-26T21:37:23.008149+0000","last_clean":"2024-04-26T21:37:23.008149+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T21:37:23.008149+0000","last_undegraded":"2024-04-26T21:37:23.008149+0000","last_fullsized":"2024-04-26T21:37:23.008149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504892+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T21:37:22.504892+0000","last_peered":"2024-04-26T21:37:22.504892+0000","last_clean":"2024-04-26T21:37:22.504892+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T21:37:22.504892+0000","last_undegraded":"2024-04-26T21:37:22.504892+0000","last_fullsized":"2024-04-26T21:37:22.504892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008990+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T21:37:23.008990+0000","last_peered":"2024-04-26T21:37:23.008990+0000","last_clean":"2024-04-26T21:37:23.008990+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T21:37:23.008990+0000","last_undegraded":"2024-04-26T21:37:23.008990+0000","last_fullsized":"2024-04-26T21:37:23.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506652+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T21:37:22.506652+0000","last_peered":"2024-04-26T21:37:22.506652+0000","last_clean":"2024-04-26T21:37:22.506652+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T21:37:22.506652+0000","last_undegraded":"2024-04-26T21:37:22.506652+0000","last_fullsized":"2024-04-26T21:37:22.506652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503917+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T21:37:22.503917+0000","last_peered":"2024-04-26T21:37:22.503917+0000","last_clean":"2024-04-26T21:37:22.503917+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T21:37:22.503917+0000","last_undegraded":"2024-04-26T21:37:22.503917+0000","last_fullsized":"2024-04-26T21:37:22.503917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835628+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T21:37:22.835628+0000","last_peered":"2024-04-26T21:37:22.835628+0000","last_clean":"2024-04-26T21:37:22.835628+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T21:37:22.835628+0000","last_undegraded":"2024-04-26T21:37:22.835628+0000","last_fullsized":"2024-04-26T21:37:22.835628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008941+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T21:37:23.008941+0000","last_peered":"2024-04-26T21:37:23.008941+0000","last_clean":"2024-04-26T21:37:23.008941+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T21:37:23.008941+0000","last_undegraded":"2024-04-26T21:37:23.008941+0000","last_fullsized":"2024-04-26T21:37:23.008941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006971+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T21:37:23.006971+0000","last_peered":"2024-04-26T21:37:23.006971+0000","last_clean":"2024-04-26T21:37:23.006971+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T21:37:23.006971+0000","last_undegraded":"2024-04-26T21:37:23.006971+0000","last_fullsized":"2024-04-26T21:37:23.006971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009805+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T21:37:23.009805+0000","last_peered":"2024-04-26T21:37:23.009805+0000","last_clean":"2024-04-26T21:37:23.009805+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T21:37:23.009805+0000","last_undegraded":"2024-04-26T21:37:23.009805+0000","last_fullsized":"2024-04-26T21:37:23.009805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506616+0000","last_change":"2024-04-26T21:37:16.418849+0000","last_active":"2024-04-26T21:37:22.506616+0000","last_peered":"2024-04-26T21:37:22.506616+0000","last_clean":"2024-04-26T21:37:22.506616+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T21:37:22.506616+0000","last_undegraded":"2024-04-26T21:37:22.506616+0000","last_fullsized":"2024-04-26T21:37:22.506616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834725+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T21:37:22.834725+0000","last_peered":"2024-04-26T21:37:22.834725+0000","last_clean":"2024-04-26T21:37:22.834725+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T21:37:22.834725+0000","last_undegraded":"2024-04-26T21:37:22.834725+0000","last_fullsized":"2024-04-26T21:37:22.834725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009172+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T21:37:23.009172+0000","last_peered":"2024-04-26T21:37:23.009172+0000","last_clean":"2024-04-26T21:37:23.009172+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T21:37:23.009172+0000","last_undegraded":"2024-04-26T21:37:23.009172+0000","last_fullsized":"2024-04-26T21:37:23.009172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.899073+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T21:37:22.899073+0000","last_peered":"2024-04-26T21:37:22.899073+0000","last_clean":"2024-04-26T21:37:22.899073+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T21:37:22.899073+0000","last_undegraded":"2024-04-26T21:37:22.899073+0000","last_fullsized":"2024-04-26T21:37:22.899073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897301+0000","last_change":"2024-04-26T21:37:21.502051+0000","last_active":"2024-04-26T21:37:22.897301+0000","last_peered":"2024-04-26T21:37:22.897301+0000","last_clean":"2024-04-26T21:37:22.897301+0000","last_became_active":"2024-04-26T21:37:21.501344+0000","last_became_peered":"2024-04-26T21:37:21.501344+0000","last_unstale":"2024-04-26T21:37:22.897301+0000","last_undegraded":"2024-04-26T21:37:22.897301+0000","last_fullsized":"2024-04-26T21:37:22.897301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:09.470569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008124+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T21:37:23.008124+0000","last_peered":"2024-04-26T21:37:23.008124+0000","last_clean":"2024-04-26T21:37:23.008124+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T21:37:23.008124+0000","last_undegraded":"2024-04-26T21:37:23.008124+0000","last_fullsized":"2024-04-26T21:37:23.008124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505059+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T21:37:22.505059+0000","last_peered":"2024-04-26T21:37:22.505059+0000","last_clean":"2024-04-26T21:37:22.505059+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T21:37:22.505059+0000","last_undegraded":"2024-04-26T21:37:22.505059+0000","last_fullsized":"2024-04-26T21:37:22.505059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007063+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T21:37:23.007063+0000","last_peered":"2024-04-26T21:37:23.007063+0000","last_clean":"2024-04-26T21:37:23.007063+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T21:37:23.007063+0000","last_undegraded":"2024-04-26T21:37:23.007063+0000","last_fullsized":"2024-04-26T21:37:23.007063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504231+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T21:37:22.504231+0000","last_peered":"2024-04-26T21:37:22.504231+0000","last_clean":"2024-04-26T21:37:22.504231+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T21:37:22.504231+0000","last_undegraded":"2024-04-26T21:37:22.504231+0000","last_fullsized":"2024-04-26T21:37:22.504231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503921+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T21:37:22.503921+0000","last_peered":"2024-04-26T21:37:22.503921+0000","last_clean":"2024-04-26T21:37:22.503921+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T21:37:22.503921+0000","last_undegraded":"2024-04-26T21:37:22.503921+0000","last_fullsized":"2024-04-26T21:37:22.503921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503817+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T21:37:22.503817+0000","last_peered":"2024-04-26T21:37:22.503817+0000","last_clean":"2024-04-26T21:37:22.503817+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T21:37:22.503817+0000","last_undegraded":"2024-04-26T21:37:22.503817+0000","last_fullsized":"2024-04-26T21:37:22.503817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008565+0000","last_change":"2024-04-26T21:37:17.449356+0000","last_active":"2024-04-26T21:37:23.008565+0000","last_peered":"2024-04-26T21:37:23.008565+0000","last_clean":"2024-04-26T21:37:23.008565+0000","last_became_active":"2024-04-26T21:37:17.449065+0000","last_became_peered":"2024-04-26T21:37:17.449065+0000","last_unstale":"2024-04-26T21:37:23.008565+0000","last_undegraded":"2024-04-26T21:37:23.008565+0000","last_fullsized":"2024-04-26T21:37:23.008565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835302+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T21:37:22.835302+0000","last_peered":"2024-04-26T21:37:22.835302+0000","last_clean":"2024-04-26T21:37:22.835302+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T21:37:22.835302+0000","last_undegraded":"2024-04-26T21:37:22.835302+0000","last_fullsized":"2024-04-26T21:37:22.835302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504365+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T21:37:22.504365+0000","last_peered":"2024-04-26T21:37:22.504365+0000","last_clean":"2024-04-26T21:37:22.504365+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T21:37:22.504365+0000","last_undegraded":"2024-04-26T21:37:22.504365+0000","last_fullsized":"2024-04-26T21:37:22.504365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006075+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T21:37:23.006075+0000","last_peered":"2024-04-26T21:37:23.006075+0000","last_clean":"2024-04-26T21:37:23.006075+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T21:37:23.006075+0000","last_undegraded":"2024-04-26T21:37:23.006075+0000","last_fullsized":"2024-04-26T21:37:23.006075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007177+0000","last_change":"2024-04-26T21:37:16.434513+0000","last_active":"2024-04-26T21:37:23.007177+0000","last_peered":"2024-04-26T21:37:23.007177+0000","last_clean":"2024-04-26T21:37:23.007177+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T21:37:23.007177+0000","last_undegraded":"2024-04-26T21:37:23.007177+0000","last_fullsized":"2024-04-26T21:37:23.007177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835847+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T21:37:22.835847+0000","last_peered":"2024-04-26T21:37:22.835847+0000","last_clean":"2024-04-26T21:37:22.835847+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T21:37:22.835847+0000","last_undegraded":"2024-04-26T21:37:22.835847+0000","last_fullsized":"2024-04-26T21:37:22.835847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008689+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T21:37:23.008689+0000","last_peered":"2024-04-26T21:37:23.008689+0000","last_clean":"2024-04-26T21:37:23.008689+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T21:37:23.008689+0000","last_undegraded":"2024-04-26T21:37:23.008689+0000","last_fullsized":"2024-04-26T21:37:23.008689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:29.456212+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T21:37:29.456212+0000","last_peered":"2024-04-26T21:37:29.456212+0000","last_clean":"2024-04-26T21:37:29.456212+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T21:37:29.456212+0000","last_undegraded":"2024-04-26T21:37:29.456212+0000","last_fullsized":"2024-04-26T21:37:29.456212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008785+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T21:37:23.008785+0000","last_peered":"2024-04-26T21:37:23.008785+0000","last_clean":"2024-04-26T21:37:23.008785+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T21:37:23.008785+0000","last_undegraded":"2024-04-26T21:37:23.008785+0000","last_fullsized":"2024-04-26T21:37:23.008785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898450+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T21:37:22.898450+0000","last_peered":"2024-04-26T21:37:22.898450+0000","last_clean":"2024-04-26T21:37:22.898450+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T21:37:22.898450+0000","last_undegraded":"2024-04-26T21:37:22.898450+0000","last_fullsized":"2024-04-26T21:37:22.898450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009035+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T21:37:23.009035+0000","last_peered":"2024-04-26T21:37:23.009035+0000","last_clean":"2024-04-26T21:37:23.009035+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T21:37:23.009035+0000","last_undegraded":"2024-04-26T21:37:23.009035+0000","last_fullsized":"2024-04-26T21:37:23.009035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898445+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T21:37:22.898445+0000","last_peered":"2024-04-26T21:37:22.898445+0000","last_clean":"2024-04-26T21:37:22.898445+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T21:37:22.898445+0000","last_undegraded":"2024-04-26T21:37:22.898445+0000","last_fullsized":"2024-04-26T21:37:22.898445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007383+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T21:37:23.007383+0000","last_peered":"2024-04-26T21:37:23.007383+0000","last_clean":"2024-04-26T21:37:23.007383+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T21:37:23.007383+0000","last_undegraded":"2024-04-26T21:37:23.007383+0000","last_fullsized":"2024-04-26T21:37:23.007383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835976+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T21:37:22.835976+0000","last_peered":"2024-04-26T21:37:22.835976+0000","last_clean":"2024-04-26T21:37:22.835976+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T21:37:22.835976+0000","last_undegraded":"2024-04-26T21:37:22.835976+0000","last_fullsized":"2024-04-26T21:37:22.835976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504073+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T21:37:22.504073+0000","last_peered":"2024-04-26T21:37:22.504073+0000","last_clean":"2024-04-26T21:37:22.504073+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T21:37:22.504073+0000","last_undegraded":"2024-04-26T21:37:22.504073+0000","last_fullsized":"2024-04-26T21:37:22.504073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835637+0000","last_change":"2024-04-26T21:37:17.448137+0000","last_active":"2024-04-26T21:37:22.835637+0000","last_peered":"2024-04-26T21:37:22.835637+0000","last_clean":"2024-04-26T21:37:22.835637+0000","last_became_active":"2024-04-26T21:37:17.447536+0000","last_became_peered":"2024-04-26T21:37:17.447536+0000","last_unstale":"2024-04-26T21:37:22.835637+0000","last_undegraded":"2024-04-26T21:37:22.835637+0000","last_fullsized":"2024-04-26T21:37:22.835637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505128+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T21:37:22.505128+0000","last_peered":"2024-04-26T21:37:22.505128+0000","last_clean":"2024-04-26T21:37:22.505128+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T21:37:22.505128+0000","last_undegraded":"2024-04-26T21:37:22.505128+0000","last_fullsized":"2024-04-26T21:37:22.505128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502604+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T21:37:22.502604+0000","last_peered":"2024-04-26T21:37:22.502604+0000","last_clean":"2024-04-26T21:37:22.502604+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T21:37:22.502604+0000","last_undegraded":"2024-04-26T21:37:22.502604+0000","last_fullsized":"2024-04-26T21:37:22.502604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006466+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T21:37:23.006466+0000","last_peered":"2024-04-26T21:37:23.006466+0000","last_clean":"2024-04-26T21:37:23.006466+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T21:37:23.006466+0000","last_undegraded":"2024-04-26T21:37:23.006466+0000","last_fullsized":"2024-04-26T21:37:23.006466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007668+0000","last_change":"2024-04-26T21:37:17.435754+0000","last_active":"2024-04-26T21:37:23.007668+0000","last_peered":"2024-04-26T21:37:23.007668+0000","last_clean":"2024-04-26T21:37:23.007668+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T21:37:23.007668+0000","last_undegraded":"2024-04-26T21:37:23.007668+0000","last_fullsized":"2024-04-26T21:37:23.007668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834917+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T21:37:22.834917+0000","last_peered":"2024-04-26T21:37:22.834917+0000","last_clean":"2024-04-26T21:37:22.834917+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T21:37:22.834917+0000","last_undegraded":"2024-04-26T21:37:22.834917+0000","last_fullsized":"2024-04-26T21:37:22.834917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504808+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T21:37:22.504808+0000","last_peered":"2024-04-26T21:37:22.504808+0000","last_clean":"2024-04-26T21:37:22.504808+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T21:37:22.504808+0000","last_undegraded":"2024-04-26T21:37:22.504808+0000","last_fullsized":"2024-04-26T21:37:22.504808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502117+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T21:37:22.502117+0000","last_peered":"2024-04-26T21:37:22.502117+0000","last_clean":"2024-04-26T21:37:22.502117+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T21:37:22.502117+0000","last_undegraded":"2024-04-26T21:37:22.502117+0000","last_fullsized":"2024-04-26T21:37:22.502117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502975+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T21:37:22.502975+0000","last_peered":"2024-04-26T21:37:22.502975+0000","last_clean":"2024-04-26T21:37:22.502975+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T21:37:22.502975+0000","last_undegraded":"2024-04-26T21:37:22.502975+0000","last_fullsized":"2024-04-26T21:37:22.502975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504177+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T21:37:22.504177+0000","last_peered":"2024-04-26T21:37:22.504177+0000","last_clean":"2024-04-26T21:37:22.504177+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T21:37:22.504177+0000","last_undegraded":"2024-04-26T21:37:22.504177+0000","last_fullsized":"2024-04-26T21:37:22.504177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007162+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T21:37:23.007162+0000","last_peered":"2024-04-26T21:37:23.007162+0000","last_clean":"2024-04-26T21:37:23.007162+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T21:37:23.007162+0000","last_undegraded":"2024-04-26T21:37:23.007162+0000","last_fullsized":"2024-04-26T21:37:23.007162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506111+0000","last_change":"2024-04-26T21:37:21.495110+0000","last_active":"2024-04-26T21:37:22.506111+0000","last_peered":"2024-04-26T21:37:22.506111+0000","last_clean":"2024-04-26T21:37:22.506111+0000","last_became_active":"2024-04-26T21:37:21.494575+0000","last_became_peered":"2024-04-26T21:37:21.494575+0000","last_unstale":"2024-04-26T21:37:22.506111+0000","last_undegraded":"2024-04-26T21:37:22.506111+0000","last_fullsized":"2024-04-26T21:37:22.506111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:07.156560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503336+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T21:37:22.503336+0000","last_peered":"2024-04-26T21:37:22.503336+0000","last_clean":"2024-04-26T21:37:22.503336+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T21:37:22.503336+0000","last_undegraded":"2024-04-26T21:37:22.503336+0000","last_fullsized":"2024-04-26T21:37:22.503336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897778+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T21:37:22.897778+0000","last_peered":"2024-04-26T21:37:22.897778+0000","last_clean":"2024-04-26T21:37:22.897778+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T21:37:22.897778+0000","last_undegraded":"2024-04-26T21:37:22.897778+0000","last_fullsized":"2024-04-26T21:37:22.897778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503622+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T21:37:22.503622+0000","last_peered":"2024-04-26T21:37:22.503622+0000","last_clean":"2024-04-26T21:37:22.503622+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T21:37:22.503622+0000","last_undegraded":"2024-04-26T21:37:22.503622+0000","last_fullsized":"2024-04-26T21:37:22.503622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503665+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T21:37:22.503665+0000","last_peered":"2024-04-26T21:37:22.503665+0000","last_clean":"2024-04-26T21:37:22.503665+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T21:37:22.503665+0000","last_undegraded":"2024-04-26T21:37:22.503665+0000","last_fullsized":"2024-04-26T21:37:22.503665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505009+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T21:37:22.505009+0000","last_peered":"2024-04-26T21:37:22.505009+0000","last_clean":"2024-04-26T21:37:22.505009+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T21:37:22.505009+0000","last_undegraded":"2024-04-26T21:37:22.505009+0000","last_fullsized":"2024-04-26T21:37:22.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:06.431151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835356+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T21:37:22.835356+0000","last_peered":"2024-04-26T21:37:22.835356+0000","last_clean":"2024-04-26T21:37:22.835356+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T21:37:22.835356+0000","last_undegraded":"2024-04-26T21:37:22.835356+0000","last_fullsized":"2024-04-26T21:37:22.835356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006871+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T21:37:23.006871+0000","last_peered":"2024-04-26T21:37:23.006871+0000","last_clean":"2024-04-26T21:37:23.006871+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T21:37:23.006871+0000","last_undegraded":"2024-04-26T21:37:23.006871+0000","last_fullsized":"2024-04-26T21:37:23.006871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504606+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T21:37:22.504606+0000","last_peered":"2024-04-26T21:37:22.504606+0000","last_clean":"2024-04-26T21:37:22.504606+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T21:37:22.504606+0000","last_undegraded":"2024-04-26T21:37:22.504606+0000","last_fullsized":"2024-04-26T21:37:22.504606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008708+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T21:37:23.008708+0000","last_peered":"2024-04-26T21:37:23.008708+0000","last_clean":"2024-04-26T21:37:23.008708+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T21:37:23.008708+0000","last_undegraded":"2024-04-26T21:37:23.008708+0000","last_fullsized":"2024-04-26T21:37:23.008708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505315+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T21:37:22.505315+0000","last_peered":"2024-04-26T21:37:22.505315+0000","last_clean":"2024-04-26T21:37:22.505315+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T21:37:22.505315+0000","last_undegraded":"2024-04-26T21:37:22.505315+0000","last_fullsized":"2024-04-26T21:37:22.505315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503899+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T21:37:22.503899+0000","last_peered":"2024-04-26T21:37:22.503899+0000","last_clean":"2024-04-26T21:37:22.503899+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T21:37:22.503899+0000","last_undegraded":"2024-04-26T21:37:22.503899+0000","last_fullsized":"2024-04-26T21:37:22.503899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834911+0000","last_change":"2024-04-26T21:37:17.444705+0000","last_active":"2024-04-26T21:37:22.834911+0000","last_peered":"2024-04-26T21:37:22.834911+0000","last_clean":"2024-04-26T21:37:22.834911+0000","last_became_active":"2024-04-26T21:37:17.443677+0000","last_became_peered":"2024-04-26T21:37:17.443677+0000","last_unstale":"2024-04-26T21:37:22.834911+0000","last_undegraded":"2024-04-26T21:37:22.834911+0000","last_fullsized":"2024-04-26T21:37:22.834911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502478+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T21:37:22.502478+0000","last_peered":"2024-04-26T21:37:22.502478+0000","last_clean":"2024-04-26T21:37:22.502478+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T21:37:22.502478+0000","last_undegraded":"2024-04-26T21:37:22.502478+0000","last_fullsized":"2024-04-26T21:37:22.502478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834945+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T21:37:22.834945+0000","last_peered":"2024-04-26T21:37:22.834945+0000","last_clean":"2024-04-26T21:37:22.834945+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T21:37:22.834945+0000","last_undegraded":"2024-04-26T21:37:22.834945+0000","last_fullsized":"2024-04-26T21:37:22.834945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006311+0000","last_change":"2024-04-26T21:37:17.439778+0000","last_active":"2024-04-26T21:37:23.006311+0000","last_peered":"2024-04-26T21:37:23.006311+0000","last_clean":"2024-04-26T21:37:23.006311+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T21:37:23.006311+0000","last_undegraded":"2024-04-26T21:37:23.006311+0000","last_fullsized":"2024-04-26T21:37:23.006311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505241+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T21:37:22.505241+0000","last_peered":"2024-04-26T21:37:22.505241+0000","last_clean":"2024-04-26T21:37:22.505241+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T21:37:22.505241+0000","last_undegraded":"2024-04-26T21:37:22.505241+0000","last_fullsized":"2024-04-26T21:37:22.505241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009389+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T21:37:23.009389+0000","last_peered":"2024-04-26T21:37:23.009389+0000","last_clean":"2024-04-26T21:37:23.009389+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T21:37:23.009389+0000","last_undegraded":"2024-04-26T21:37:23.009389+0000","last_fullsized":"2024-04-26T21:37:23.009389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506334+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T21:37:22.506334+0000","last_peered":"2024-04-26T21:37:22.506334+0000","last_clean":"2024-04-26T21:37:22.506334+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T21:37:22.506334+0000","last_undegraded":"2024-04-26T21:37:22.506334+0000","last_fullsized":"2024-04-26T21:37:22.506334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:34.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836379+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T21:37:22.836379+0000","last_peered":"2024-04-26T21:37:22.836379+0000","last_clean":"2024-04-26T21:37:22.836379+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T21:37:22.836379+0000","last_undegraded":"2024-04-26T21:37:22.836379+0000","last_fullsized":"2024-04-26T21:37:22.836379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834542+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T21:37:22.834542+0000","last_peered":"2024-04-26T21:37:22.834542+0000","last_clean":"2024-04-26T21:37:22.834542+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T21:37:22.834542+0000","last_undegraded":"2024-04-26T21:37:22.834542+0000","last_fullsized":"2024-04-26T21:37:22.834542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007729+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T21:37:23.007729+0000","last_peered":"2024-04-26T21:37:23.007729+0000","last_clean":"2024-04-26T21:37:23.007729+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T21:37:23.007729+0000","last_undegraded":"2024-04-26T21:37:23.007729+0000","last_fullsized":"2024-04-26T21:37:23.007729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005927+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T21:37:23.005927+0000","last_peered":"2024-04-26T21:37:23.005927+0000","last_clean":"2024-04-26T21:37:23.005927+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T21:37:23.005927+0000","last_undegraded":"2024-04-26T21:37:23.005927+0000","last_fullsized":"2024-04-26T21:37:23.005927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:38.335510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502794+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T21:37:22.502794+0000","last_peered":"2024-04-26T21:37:22.502794+0000","last_clean":"2024-04-26T21:37:22.502794+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T21:37:22.502794+0000","last_undegraded":"2024-04-26T21:37:22.502794+0000","last_fullsized":"2024-04-26T21:37:22.502794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898187+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T21:37:22.898187+0000","last_peered":"2024-04-26T21:37:22.898187+0000","last_clean":"2024-04-26T21:37:22.898187+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T21:37:22.898187+0000","last_undegraded":"2024-04-26T21:37:22.898187+0000","last_fullsized":"2024-04-26T21:37:22.898187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504907+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T21:37:22.504907+0000","last_peered":"2024-04-26T21:37:22.504907+0000","last_clean":"2024-04-26T21:37:22.504907+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T21:37:22.504907+0000","last_undegraded":"2024-04-26T21:37:22.504907+0000","last_fullsized":"2024-04-26T21:37:22.504907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505211+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T21:37:22.505211+0000","last_peered":"2024-04-26T21:37:22.505211+0000","last_clean":"2024-04-26T21:37:22.505211+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T21:37:22.505211+0000","last_undegraded":"2024-04-26T21:37:22.505211+0000","last_fullsized":"2024-04-26T21:37:22.505211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009791+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T21:37:23.009791+0000","last_peered":"2024-04-26T21:37:23.009791+0000","last_clean":"2024-04-26T21:37:23.009791+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T21:37:23.009791+0000","last_undegraded":"2024-04-26T21:37:23.009791+0000","last_fullsized":"2024-04-26T21:37:23.009791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501800+0000","last_change":"2024-04-26T21:37:17.446605+0000","last_active":"2024-04-26T21:37:22.501800+0000","last_peered":"2024-04-26T21:37:22.501800+0000","last_clean":"2024-04-26T21:37:22.501800+0000","last_became_active":"2024-04-26T21:37:17.446226+0000","last_became_peered":"2024-04-26T21:37:17.446226+0000","last_unstale":"2024-04-26T21:37:22.501800+0000","last_undegraded":"2024-04-26T21:37:22.501800+0000","last_fullsized":"2024-04-26T21:37:22.501800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007819+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T21:37:23.007819+0000","last_peered":"2024-04-26T21:37:23.007819+0000","last_clean":"2024-04-26T21:37:23.007819+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T21:37:23.007819+0000","last_undegraded":"2024-04-26T21:37:23.007819+0000","last_fullsized":"2024-04-26T21:37:23.007819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834855+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T21:37:22.834855+0000","last_peered":"2024-04-26T21:37:22.834855+0000","last_clean":"2024-04-26T21:37:22.834855+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T21:37:22.834855+0000","last_undegraded":"2024-04-26T21:37:22.834855+0000","last_fullsized":"2024-04-26T21:37:22.834855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008305+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T21:37:23.008305+0000","last_peered":"2024-04-26T21:37:23.008305+0000","last_clean":"2024-04-26T21:37:23.008305+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T21:37:23.008305+0000","last_undegraded":"2024-04-26T21:37:23.008305+0000","last_fullsized":"2024-04-26T21:37:23.008305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835990+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T21:37:22.835990+0000","last_peered":"2024-04-26T21:37:22.835990+0000","last_clean":"2024-04-26T21:37:22.835990+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T21:37:22.835990+0000","last_undegraded":"2024-04-26T21:37:22.835990+0000","last_fullsized":"2024-04-26T21:37:22.835990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006647+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T21:37:23.006647+0000","last_peered":"2024-04-26T21:37:23.006647+0000","last_clean":"2024-04-26T21:37:23.006647+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T21:37:23.006647+0000","last_undegraded":"2024-04-26T21:37:23.006647+0000","last_fullsized":"2024-04-26T21:37:23.006647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009135+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T21:37:23.009135+0000","last_peered":"2024-04-26T21:37:23.009135+0000","last_clean":"2024-04-26T21:37:23.009135+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T21:37:23.009135+0000","last_undegraded":"2024-04-26T21:37:23.009135+0000","last_fullsized":"2024-04-26T21:37:23.009135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009638+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T21:37:23.009638+0000","last_peered":"2024-04-26T21:37:23.009638+0000","last_clean":"2024-04-26T21:37:23.009638+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T21:37:23.009638+0000","last_undegraded":"2024-04-26T21:37:23.009638+0000","last_fullsized":"2024-04-26T21:37:23.009638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:37:41.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:37:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.303+0000 7f5f7da00640 1 Processor -- start 2024-04-26T21:37:41.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.303+0000 7f5f7da00640 1 -- start start 2024-04-26T21:37:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.305+0000 7f5f7da00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f7814bdc0 0x7f5f780b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.305+0000 7f5f7da00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7814c1a0 con 0x7f5f780b3300 2024-04-26T21:37:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.305+0000 7f5f7da00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f780aea20 con 0x7f5f78073ca0 2024-04-26T21:37:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.305+0000 7f5f7da00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5f7814ca10 con 0x7f5f7814bdc0 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.305+0000 7f5f6fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f780b3300 0x7f5f78073590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56126/0 (socket says 172.21.15.5:56126) 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.305+0000 7f5f77e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f7814bdc0 0x7f5f780b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.305+0000 7f5f6fe00640 1 -- 172.21.15.5:0/3046772993 learned_addr learned my addr 172.21.15.5:0/3046772993 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.306+0000 7f5f77400640 1 -- 172.21.15.5:0/3046772993 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751726776 0 0) 0x7f5f7814c1a0 con 0x7f5f780b3300 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.306+0000 7f5f77400640 1 -- 172.21.15.5:0/3046772993 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f5c003520 con 0x7f5f780b3300 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.306+0000 7f5f77e00640 1 -- 172.21.15.5:0/3046772993 >> v1:172.21.15.112:6789/0 conn(0x7f5f78073ca0 legacy=0x7f5f78152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.306+0000 7f5f77e00640 1 -- 172.21.15.5:0/3046772993 >> v1:172.21.15.5:6789/0 conn(0x7f5f780b3300 legacy=0x7f5f78073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.306+0000 7f5f77e00640 1 -- 172.21.15.5:0/3046772993 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7814c450 con 0x7f5f7814bdc0 2024-04-26T21:37:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.308+0000 7f5f77e00640 1 --2- 172.21.15.5:0/3046772993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f780b46c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f680097a0 tx=0x7f5f6802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade57f00b456b735 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.308+0000 7f5f77400640 1 -- 172.21.15.5:0/3046772993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f68037070 con 0x7f5f7814bdc0 2024-04-26T21:37:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.308+0000 7f5f77400640 1 -- 172.21.15.5:0/3046772993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f68032440 con 0x7f5f7814bdc0 2024-04-26T21:37:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.308+0000 7f5f77400640 1 -- 172.21.15.5:0/3046772993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f68032810 con 0x7f5f7814bdc0 2024-04-26T21:37:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.309+0000 7f5f7da00640 1 -- 172.21.15.5:0/3046772993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 msgr2=0x7f5f780b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.309+0000 7f5f7da00640 1 --2- 172.21.15.5:0/3046772993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f780b46c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f680097a0 tx=0x7f5f6802a1a0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.309+0000 7f5f7da00640 1 -- 172.21.15.5:0/3046772993 shutdown_connections 2024-04-26T21:37:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.309+0000 7f5f7da00640 1 --2- 172.21.15.5:0/3046772993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f780b46c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.309+0000 7f5f7da00640 1 -- 172.21.15.5:0/3046772993 >> 172.21.15.5:0/3046772993 conn(0x7f5f7806c300 msgr2=0x7f5f7806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.309+0000 7f5f7da00640 1 -- 172.21.15.5:0/3046772993 shutdown_connections 2024-04-26T21:37:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.309+0000 7f5f7da00640 1 -- 172.21.15.5:0/3046772993 wait complete. 2024-04-26T21:37:41.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.311+0000 7f5f7da00640 1 Processor -- start 2024-04-26T21:37:41.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.311+0000 7f5f7da00640 1 -- start start 2024-04-26T21:37:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.312+0000 7f5f7da00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f78073ca0 0x7f5f781d2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.312+0000 7f5f7da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f780b3300 0x7f5f781ddc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.312+0000 7f5f7da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f781d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.312+0000 7f5f7da00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f780afe80 con 0x7f5f7814bdc0 2024-04-26T21:37:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.312+0000 7f5f7da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7806ec40 con 0x7f5f780b3300 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.312+0000 7f5f7da00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5f780b0000 con 0x7f5f78073ca0 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f781d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f781d4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49292/0 (socket says 172.21.15.5:49292) 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 -- 172.21.15.5:0/1592688690 learned_addr learned my addr 172.21.15.5:0/1592688690 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f77e00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f78073ca0 0x7f5f781d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f6fe00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f780b3300 0x7f5f781ddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 -- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f78073ca0 msgr2=0x7f5f781d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f78073ca0 0x7f5f781d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 -- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f780b3300 msgr2=0x7f5f781ddc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f780b3300 0x7f5f781ddc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.313+0000 7f5f7d000640 1 -- 172.21.15.5:0/1592688690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f780b96a0 con 0x7f5f7814bdc0 2024-04-26T21:37:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.314+0000 7f5f7d000640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f781d4de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c7a0 tx=0x7f5f7000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.314+0000 7f5f74c00640 1 -- 172.21.15.5:0/1592688690 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70003b70 con 0x7f5f7814bdc0 2024-04-26T21:37:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.314+0000 7f5f74c00640 1 -- 172.21.15.5:0/1592688690 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f70003d30 con 0x7f5f7814bdc0 2024-04-26T21:37:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.314+0000 7f5f74c00640 1 -- 172.21.15.5:0/1592688690 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000aa90 con 0x7f5f7814bdc0 2024-04-26T21:37:41.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.314+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f781d35d0 con 0x7f5f7814bdc0 2024-04-26T21:37:41.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.314+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f78072430 con 0x7f5f7814bdc0 2024-04-26T21:37:41.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.315+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f78075db0 con 0x7f5f7814bdc0 2024-04-26T21:37:41.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.316+0000 7f5f74c00640 1 -- 172.21.15.5:0/1592688690 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f7000ac30 con 0x7f5f7814bdc0 2024-04-26T21:37:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.317+0000 7f5f74c00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5f5406c920 0x7f5f5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.317+0000 7f5f74c00640 1 -- 172.21.15.5:0/1592688690 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5f7008bda0 con 0x7f5f7814bdc0 2024-04-26T21:37:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.318+0000 7f5f77e00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5f5406c920 0x7f5f5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.319+0000 7f5f77e00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5f5406c920 0x7f5f5406ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f68034000 tx=0x7f5f6802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:41.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.322+0000 7f5f74c00640 1 -- 172.21.15.5:0/1592688690 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5f70059e80 con 0x7f5f7814bdc0 2024-04-26T21:37:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.528+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f780b49e0 con 0x7f5f5406c920 2024-04-26T21:37:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.552+0000 7f5f74c00640 1 -- 172.21.15.5:0/1592688690 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332574 (secure 0 0 0) 0x7f5f780b49e0 con 0x7f5f5406c920 2024-04-26T21:37:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T21:37:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.560+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5f5406c920 msgr2=0x7f5f5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.560+0000 7f5f7da00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5f5406c920 0x7f5f5406ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f68034000 tx=0x7f5f6802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.560+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 msgr2=0x7f5f781d4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.560+0000 7f5f7da00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f781d4de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c7a0 tx=0x7f5f7000cc60 comp rx=0 tx=0).stop 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 shutdown_connections 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5f5406c920 0x7f5f5406ede0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7814bdc0 0x7f5f781d4de0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f780b3300 0x7f5f781ddc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 --2- 172.21.15.5:0/1592688690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f78073ca0 0x7f5f781d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 >> 172.21.15.5:0/1592688690 conn(0x7f5f7806c300 msgr2=0x7f5f78149a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 shutdown_connections 2024-04-26T21:37:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.561+0000 7f5f7da00640 1 -- 172.21.15.5:0/1592688690 wait complete. 2024-04-26T21:37:41.580 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-26T21:37:41.459100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227704,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747016,"statfs":{"total":773094113280,"available":772860944384,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":229756468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005571"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007792+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T21:37:23.007792+0000","last_peered":"2024-04-26T21:37:23.007792+0000","last_clean":"2024-04-26T21:37:23.007792+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T21:37:23.007792+0000","last_undegraded":"2024-04-26T21:37:23.007792+0000","last_fullsized":"2024-04-26T21:37:23.007792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:32.834699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504581+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T21:37:22.504581+0000","last_peered":"2024-04-26T21:37:22.504581+0000","last_clean":"2024-04-26T21:37:22.504581+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T21:37:22.504581+0000","last_undegraded":"2024-04-26T21:37:22.504581+0000","last_fullsized":"2024-04-26T21:37:22.504581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502119+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T21:37:22.502119+0000","last_peered":"2024-04-26T21:37:22.502119+0000","last_clean":"2024-04-26T21:37:22.502119+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T21:37:22.502119+0000","last_undegraded":"2024-04-26T21:37:22.502119+0000","last_fullsized":"2024-04-26T21:37:22.502119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505039+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T21:37:22.505039+0000","last_peered":"2024-04-26T21:37:22.505039+0000","last_clean":"2024-04-26T21:37:22.505039+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T21:37:22.505039+0000","last_undegraded":"2024-04-26T21:37:22.505039+0000","last_fullsized":"2024-04-26T21:37:22.505039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006872+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T21:37:23.006872+0000","last_peered":"2024-04-26T21:37:23.006872+0000","last_clean":"2024-04-26T21:37:23.006872+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T21:37:23.006872+0000","last_undegraded":"2024-04-26T21:37:23.006872+0000","last_fullsized":"2024-04-26T21:37:23.006872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897958+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T21:37:22.897958+0000","last_peered":"2024-04-26T21:37:22.897958+0000","last_clean":"2024-04-26T21:37:22.897958+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T21:37:22.897958+0000","last_undegraded":"2024-04-26T21:37:22.897958+0000","last_fullsized":"2024-04-26T21:37:22.897958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009318+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T21:37:23.009318+0000","last_peered":"2024-04-26T21:37:23.009318+0000","last_clean":"2024-04-26T21:37:23.009318+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T21:37:23.009318+0000","last_undegraded":"2024-04-26T21:37:23.009318+0000","last_fullsized":"2024-04-26T21:37:23.009318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835366+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T21:37:22.835366+0000","last_peered":"2024-04-26T21:37:22.835366+0000","last_clean":"2024-04-26T21:37:22.835366+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T21:37:22.835366+0000","last_undegraded":"2024-04-26T21:37:22.835366+0000","last_fullsized":"2024-04-26T21:37:22.835366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897760+0000","last_change":"2024-04-26T21:37:21.501976+0000","last_active":"2024-04-26T21:37:22.897760+0000","last_peered":"2024-04-26T21:37:22.897760+0000","last_clean":"2024-04-26T21:37:22.897760+0000","last_became_active":"2024-04-26T21:37:21.501426+0000","last_became_peered":"2024-04-26T21:37:21.501426+0000","last_unstale":"2024-04-26T21:37:22.897760+0000","last_undegraded":"2024-04-26T21:37:22.897760+0000","last_fullsized":"2024-04-26T21:37:22.897760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:44.895996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008636+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T21:37:23.008636+0000","last_peered":"2024-04-26T21:37:23.008636+0000","last_clean":"2024-04-26T21:37:23.008636+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T21:37:23.008636+0000","last_undegraded":"2024-04-26T21:37:23.008636+0000","last_fullsized":"2024-04-26T21:37:23.008636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835679+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T21:37:22.835679+0000","last_peered":"2024-04-26T21:37:22.835679+0000","last_clean":"2024-04-26T21:37:22.835679+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T21:37:22.835679+0000","last_undegraded":"2024-04-26T21:37:22.835679+0000","last_fullsized":"2024-04-26T21:37:22.835679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897630+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T21:37:22.897630+0000","last_peered":"2024-04-26T21:37:22.897630+0000","last_clean":"2024-04-26T21:37:22.897630+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T21:37:22.897630+0000","last_undegraded":"2024-04-26T21:37:22.897630+0000","last_fullsized":"2024-04-26T21:37:22.897630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503627+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T21:37:22.503627+0000","last_peered":"2024-04-26T21:37:22.503627+0000","last_clean":"2024-04-26T21:37:22.503627+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T21:37:22.503627+0000","last_undegraded":"2024-04-26T21:37:22.503627+0000","last_fullsized":"2024-04-26T21:37:22.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008824+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T21:37:23.008824+0000","last_peered":"2024-04-26T21:37:23.008824+0000","last_clean":"2024-04-26T21:37:23.008824+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T21:37:23.008824+0000","last_undegraded":"2024-04-26T21:37:23.008824+0000","last_fullsized":"2024-04-26T21:37:23.008824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898971+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T21:37:22.898971+0000","last_peered":"2024-04-26T21:37:22.898971+0000","last_clean":"2024-04-26T21:37:22.898971+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T21:37:22.898971+0000","last_undegraded":"2024-04-26T21:37:22.898971+0000","last_fullsized":"2024-04-26T21:37:22.898971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503070+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T21:37:22.503070+0000","last_peered":"2024-04-26T21:37:22.503070+0000","last_clean":"2024-04-26T21:37:22.503070+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T21:37:22.503070+0000","last_undegraded":"2024-04-26T21:37:22.503070+0000","last_fullsized":"2024-04-26T21:37:22.503070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008916+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T21:37:23.008916+0000","last_peered":"2024-04-26T21:37:23.008916+0000","last_clean":"2024-04-26T21:37:23.008916+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T21:37:23.008916+0000","last_undegraded":"2024-04-26T21:37:23.008916+0000","last_fullsized":"2024-04-26T21:37:23.008916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898299+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T21:37:22.898299+0000","last_peered":"2024-04-26T21:37:22.898299+0000","last_clean":"2024-04-26T21:37:22.898299+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T21:37:22.898299+0000","last_undegraded":"2024-04-26T21:37:22.898299+0000","last_fullsized":"2024-04-26T21:37:22.898299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502408+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T21:37:22.502408+0000","last_peered":"2024-04-26T21:37:22.502408+0000","last_clean":"2024-04-26T21:37:22.502408+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T21:37:22.502408+0000","last_undegraded":"2024-04-26T21:37:22.502408+0000","last_fullsized":"2024-04-26T21:37:22.502408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007771+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T21:37:23.007771+0000","last_peered":"2024-04-26T21:37:23.007771+0000","last_clean":"2024-04-26T21:37:23.007771+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T21:37:23.007771+0000","last_undegraded":"2024-04-26T21:37:23.007771+0000","last_fullsized":"2024-04-26T21:37:23.007771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009132+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T21:37:23.009132+0000","last_peered":"2024-04-26T21:37:23.009132+0000","last_clean":"2024-04-26T21:37:23.009132+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T21:37:23.009132+0000","last_undegraded":"2024-04-26T21:37:23.009132+0000","last_fullsized":"2024-04-26T21:37:23.009132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898265+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T21:37:22.898265+0000","last_peered":"2024-04-26T21:37:22.898265+0000","last_clean":"2024-04-26T21:37:22.898265+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T21:37:22.898265+0000","last_undegraded":"2024-04-26T21:37:22.898265+0000","last_fullsized":"2024-04-26T21:37:22.898265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007818+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T21:37:23.007818+0000","last_peered":"2024-04-26T21:37:23.007818+0000","last_clean":"2024-04-26T21:37:23.007818+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T21:37:23.007818+0000","last_undegraded":"2024-04-26T21:37:23.007818+0000","last_fullsized":"2024-04-26T21:37:23.007818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898858+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T21:37:22.898858+0000","last_peered":"2024-04-26T21:37:22.898858+0000","last_clean":"2024-04-26T21:37:22.898858+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T21:37:22.898858+0000","last_undegraded":"2024-04-26T21:37:22.898858+0000","last_fullsized":"2024-04-26T21:37:22.898858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007135+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T21:37:23.007135+0000","last_peered":"2024-04-26T21:37:23.007135+0000","last_clean":"2024-04-26T21:37:23.007135+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T21:37:23.007135+0000","last_undegraded":"2024-04-26T21:37:23.007135+0000","last_fullsized":"2024-04-26T21:37:23.007135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505636+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T21:37:22.505636+0000","last_peered":"2024-04-26T21:37:22.505636+0000","last_clean":"2024-04-26T21:37:22.505636+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T21:37:22.505636+0000","last_undegraded":"2024-04-26T21:37:22.505636+0000","last_fullsized":"2024-04-26T21:37:22.505636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897853+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T21:37:22.897853+0000","last_peered":"2024-04-26T21:37:22.897853+0000","last_clean":"2024-04-26T21:37:22.897853+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T21:37:22.897853+0000","last_undegraded":"2024-04-26T21:37:22.897853+0000","last_fullsized":"2024-04-26T21:37:22.897853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504219+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T21:37:22.504219+0000","last_peered":"2024-04-26T21:37:22.504219+0000","last_clean":"2024-04-26T21:37:22.504219+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T21:37:22.504219+0000","last_undegraded":"2024-04-26T21:37:22.504219+0000","last_fullsized":"2024-04-26T21:37:22.504219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009255+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T21:37:23.009255+0000","last_peered":"2024-04-26T21:37:23.009255+0000","last_clean":"2024-04-26T21:37:23.009255+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T21:37:23.009255+0000","last_undegraded":"2024-04-26T21:37:23.009255+0000","last_fullsized":"2024-04-26T21:37:23.009255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501932+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T21:37:22.501932+0000","last_peered":"2024-04-26T21:37:22.501932+0000","last_clean":"2024-04-26T21:37:22.501932+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T21:37:22.501932+0000","last_undegraded":"2024-04-26T21:37:22.501932+0000","last_fullsized":"2024-04-26T21:37:22.501932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008562+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T21:37:23.008562+0000","last_peered":"2024-04-26T21:37:23.008562+0000","last_clean":"2024-04-26T21:37:23.008562+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T21:37:23.008562+0000","last_undegraded":"2024-04-26T21:37:23.008562+0000","last_fullsized":"2024-04-26T21:37:23.008562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009625+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T21:37:23.009625+0000","last_peered":"2024-04-26T21:37:23.009625+0000","last_clean":"2024-04-26T21:37:23.009625+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T21:37:23.009625+0000","last_undegraded":"2024-04-26T21:37:23.009625+0000","last_fullsized":"2024-04-26T21:37:23.009625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006714+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T21:37:23.006714+0000","last_peered":"2024-04-26T21:37:23.006714+0000","last_clean":"2024-04-26T21:37:23.006714+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T21:37:23.006714+0000","last_undegraded":"2024-04-26T21:37:23.006714+0000","last_fullsized":"2024-04-26T21:37:23.006714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836004+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T21:37:22.836004+0000","last_peered":"2024-04-26T21:37:22.836004+0000","last_clean":"2024-04-26T21:37:22.836004+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T21:37:22.836004+0000","last_undegraded":"2024-04-26T21:37:22.836004+0000","last_fullsized":"2024-04-26T21:37:22.836004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008627+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T21:37:23.008627+0000","last_peered":"2024-04-26T21:37:23.008627+0000","last_clean":"2024-04-26T21:37:23.008627+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T21:37:23.008627+0000","last_undegraded":"2024-04-26T21:37:23.008627+0000","last_fullsized":"2024-04-26T21:37:23.008627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008859+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T21:37:23.008859+0000","last_peered":"2024-04-26T21:37:23.008859+0000","last_clean":"2024-04-26T21:37:23.008859+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T21:37:23.008859+0000","last_undegraded":"2024-04-26T21:37:23.008859+0000","last_fullsized":"2024-04-26T21:37:23.008859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898544+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T21:37:22.898544+0000","last_peered":"2024-04-26T21:37:22.898544+0000","last_clean":"2024-04-26T21:37:22.898544+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T21:37:22.898544+0000","last_undegraded":"2024-04-26T21:37:22.898544+0000","last_fullsized":"2024-04-26T21:37:22.898544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835574+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T21:37:22.835574+0000","last_peered":"2024-04-26T21:37:22.835574+0000","last_clean":"2024-04-26T21:37:22.835574+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T21:37:22.835574+0000","last_undegraded":"2024-04-26T21:37:22.835574+0000","last_fullsized":"2024-04-26T21:37:22.835574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008566+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T21:37:23.008566+0000","last_peered":"2024-04-26T21:37:23.008566+0000","last_clean":"2024-04-26T21:37:23.008566+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T21:37:23.008566+0000","last_undegraded":"2024-04-26T21:37:23.008566+0000","last_fullsized":"2024-04-26T21:37:23.008566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007854+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T21:37:23.007854+0000","last_peered":"2024-04-26T21:37:23.007854+0000","last_clean":"2024-04-26T21:37:23.007854+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T21:37:23.007854+0000","last_undegraded":"2024-04-26T21:37:23.007854+0000","last_fullsized":"2024-04-26T21:37:23.007854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505152+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T21:37:22.505152+0000","last_peered":"2024-04-26T21:37:22.505152+0000","last_clean":"2024-04-26T21:37:22.505152+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T21:37:22.505152+0000","last_undegraded":"2024-04-26T21:37:22.505152+0000","last_fullsized":"2024-04-26T21:37:22.505152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009481+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T21:37:23.009481+0000","last_peered":"2024-04-26T21:37:23.009481+0000","last_clean":"2024-04-26T21:37:23.009481+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T21:37:23.009481+0000","last_undegraded":"2024-04-26T21:37:23.009481+0000","last_fullsized":"2024-04-26T21:37:23.009481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005333+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T21:37:23.005333+0000","last_peered":"2024-04-26T21:37:23.005333+0000","last_clean":"2024-04-26T21:37:23.005333+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T21:37:23.005333+0000","last_undegraded":"2024-04-26T21:37:23.005333+0000","last_fullsized":"2024-04-26T21:37:23.005333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:03.104148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007821+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T21:37:23.007821+0000","last_peered":"2024-04-26T21:37:23.007821+0000","last_clean":"2024-04-26T21:37:23.007821+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T21:37:23.007821+0000","last_undegraded":"2024-04-26T21:37:23.007821+0000","last_fullsized":"2024-04-26T21:37:23.007821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007190+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T21:37:23.007190+0000","last_peered":"2024-04-26T21:37:23.007190+0000","last_clean":"2024-04-26T21:37:23.007190+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T21:37:23.007190+0000","last_undegraded":"2024-04-26T21:37:23.007190+0000","last_fullsized":"2024-04-26T21:37:23.007190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502972+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T21:37:22.502972+0000","last_peered":"2024-04-26T21:37:22.502972+0000","last_clean":"2024-04-26T21:37:22.502972+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T21:37:22.502972+0000","last_undegraded":"2024-04-26T21:37:22.502972+0000","last_fullsized":"2024-04-26T21:37:22.502972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835398+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T21:37:22.835398+0000","last_peered":"2024-04-26T21:37:22.835398+0000","last_clean":"2024-04-26T21:37:22.835398+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T21:37:22.835398+0000","last_undegraded":"2024-04-26T21:37:22.835398+0000","last_fullsized":"2024-04-26T21:37:22.835398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008149+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T21:37:23.008149+0000","last_peered":"2024-04-26T21:37:23.008149+0000","last_clean":"2024-04-26T21:37:23.008149+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T21:37:23.008149+0000","last_undegraded":"2024-04-26T21:37:23.008149+0000","last_fullsized":"2024-04-26T21:37:23.008149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504892+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T21:37:22.504892+0000","last_peered":"2024-04-26T21:37:22.504892+0000","last_clean":"2024-04-26T21:37:22.504892+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T21:37:22.504892+0000","last_undegraded":"2024-04-26T21:37:22.504892+0000","last_fullsized":"2024-04-26T21:37:22.504892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008990+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T21:37:23.008990+0000","last_peered":"2024-04-26T21:37:23.008990+0000","last_clean":"2024-04-26T21:37:23.008990+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T21:37:23.008990+0000","last_undegraded":"2024-04-26T21:37:23.008990+0000","last_fullsized":"2024-04-26T21:37:23.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506652+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T21:37:22.506652+0000","last_peered":"2024-04-26T21:37:22.506652+0000","last_clean":"2024-04-26T21:37:22.506652+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T21:37:22.506652+0000","last_undegraded":"2024-04-26T21:37:22.506652+0000","last_fullsized":"2024-04-26T21:37:22.506652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503917+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T21:37:22.503917+0000","last_peered":"2024-04-26T21:37:22.503917+0000","last_clean":"2024-04-26T21:37:22.503917+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T21:37:22.503917+0000","last_undegraded":"2024-04-26T21:37:22.503917+0000","last_fullsized":"2024-04-26T21:37:22.503917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835628+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T21:37:22.835628+0000","last_peered":"2024-04-26T21:37:22.835628+0000","last_clean":"2024-04-26T21:37:22.835628+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T21:37:22.835628+0000","last_undegraded":"2024-04-26T21:37:22.835628+0000","last_fullsized":"2024-04-26T21:37:22.835628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008941+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T21:37:23.008941+0000","last_peered":"2024-04-26T21:37:23.008941+0000","last_clean":"2024-04-26T21:37:23.008941+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T21:37:23.008941+0000","last_undegraded":"2024-04-26T21:37:23.008941+0000","last_fullsized":"2024-04-26T21:37:23.008941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006971+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T21:37:23.006971+0000","last_peered":"2024-04-26T21:37:23.006971+0000","last_clean":"2024-04-26T21:37:23.006971+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T21:37:23.006971+0000","last_undegraded":"2024-04-26T21:37:23.006971+0000","last_fullsized":"2024-04-26T21:37:23.006971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009805+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T21:37:23.009805+0000","last_peered":"2024-04-26T21:37:23.009805+0000","last_clean":"2024-04-26T21:37:23.009805+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T21:37:23.009805+0000","last_undegraded":"2024-04-26T21:37:23.009805+0000","last_fullsized":"2024-04-26T21:37:23.009805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506616+0000","last_change":"2024-04-26T21:37:16.418849+0000","last_active":"2024-04-26T21:37:22.506616+0000","last_peered":"2024-04-26T21:37:22.506616+0000","last_clean":"2024-04-26T21:37:22.506616+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T21:37:22.506616+0000","last_undegraded":"2024-04-26T21:37:22.506616+0000","last_fullsized":"2024-04-26T21:37:22.506616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834725+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T21:37:22.834725+0000","last_peered":"2024-04-26T21:37:22.834725+0000","last_clean":"2024-04-26T21:37:22.834725+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T21:37:22.834725+0000","last_undegraded":"2024-04-26T21:37:22.834725+0000","last_fullsized":"2024-04-26T21:37:22.834725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009172+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T21:37:23.009172+0000","last_peered":"2024-04-26T21:37:23.009172+0000","last_clean":"2024-04-26T21:37:23.009172+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T21:37:23.009172+0000","last_undegraded":"2024-04-26T21:37:23.009172+0000","last_fullsized":"2024-04-26T21:37:23.009172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.899073+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T21:37:22.899073+0000","last_peered":"2024-04-26T21:37:22.899073+0000","last_clean":"2024-04-26T21:37:22.899073+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T21:37:22.899073+0000","last_undegraded":"2024-04-26T21:37:22.899073+0000","last_fullsized":"2024-04-26T21:37:22.899073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897301+0000","last_change":"2024-04-26T21:37:21.502051+0000","last_active":"2024-04-26T21:37:22.897301+0000","last_peered":"2024-04-26T21:37:22.897301+0000","last_clean":"2024-04-26T21:37:22.897301+0000","last_became_active":"2024-04-26T21:37:21.501344+0000","last_became_peered":"2024-04-26T21:37:21.501344+0000","last_unstale":"2024-04-26T21:37:22.897301+0000","last_undegraded":"2024-04-26T21:37:22.897301+0000","last_fullsized":"2024-04-26T21:37:22.897301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:09.470569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008124+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T21:37:23.008124+0000","last_peered":"2024-04-26T21:37:23.008124+0000","last_clean":"2024-04-26T21:37:23.008124+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T21:37:23.008124+0000","last_undegraded":"2024-04-26T21:37:23.008124+0000","last_fullsized":"2024-04-26T21:37:23.008124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505059+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T21:37:22.505059+0000","last_peered":"2024-04-26T21:37:22.505059+0000","last_clean":"2024-04-26T21:37:22.505059+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T21:37:22.505059+0000","last_undegraded":"2024-04-26T21:37:22.505059+0000","last_fullsized":"2024-04-26T21:37:22.505059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007063+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T21:37:23.007063+0000","last_peered":"2024-04-26T21:37:23.007063+0000","last_clean":"2024-04-26T21:37:23.007063+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T21:37:23.007063+0000","last_undegraded":"2024-04-26T21:37:23.007063+0000","last_fullsized":"2024-04-26T21:37:23.007063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504231+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T21:37:22.504231+0000","last_peered":"2024-04-26T21:37:22.504231+0000","last_clean":"2024-04-26T21:37:22.504231+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T21:37:22.504231+0000","last_undegraded":"2024-04-26T21:37:22.504231+0000","last_fullsized":"2024-04-26T21:37:22.504231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503921+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T21:37:22.503921+0000","last_peered":"2024-04-26T21:37:22.503921+0000","last_clean":"2024-04-26T21:37:22.503921+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T21:37:22.503921+0000","last_undegraded":"2024-04-26T21:37:22.503921+0000","last_fullsized":"2024-04-26T21:37:22.503921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503817+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T21:37:22.503817+0000","last_peered":"2024-04-26T21:37:22.503817+0000","last_clean":"2024-04-26T21:37:22.503817+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T21:37:22.503817+0000","last_undegraded":"2024-04-26T21:37:22.503817+0000","last_fullsized":"2024-04-26T21:37:22.503817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008565+0000","last_change":"2024-04-26T21:37:17.449356+0000","last_active":"2024-04-26T21:37:23.008565+0000","last_peered":"2024-04-26T21:37:23.008565+0000","last_clean":"2024-04-26T21:37:23.008565+0000","last_became_active":"2024-04-26T21:37:17.449065+0000","last_became_peered":"2024-04-26T21:37:17.449065+0000","last_unstale":"2024-04-26T21:37:23.008565+0000","last_undegraded":"2024-04-26T21:37:23.008565+0000","last_fullsized":"2024-04-26T21:37:23.008565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835302+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T21:37:22.835302+0000","last_peered":"2024-04-26T21:37:22.835302+0000","last_clean":"2024-04-26T21:37:22.835302+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T21:37:22.835302+0000","last_undegraded":"2024-04-26T21:37:22.835302+0000","last_fullsized":"2024-04-26T21:37:22.835302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504365+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T21:37:22.504365+0000","last_peered":"2024-04-26T21:37:22.504365+0000","last_clean":"2024-04-26T21:37:22.504365+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T21:37:22.504365+0000","last_undegraded":"2024-04-26T21:37:22.504365+0000","last_fullsized":"2024-04-26T21:37:22.504365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006075+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T21:37:23.006075+0000","last_peered":"2024-04-26T21:37:23.006075+0000","last_clean":"2024-04-26T21:37:23.006075+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T21:37:23.006075+0000","last_undegraded":"2024-04-26T21:37:23.006075+0000","last_fullsized":"2024-04-26T21:37:23.006075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007177+0000","last_change":"2024-04-26T21:37:16.434513+0000","last_active":"2024-04-26T21:37:23.007177+0000","last_peered":"2024-04-26T21:37:23.007177+0000","last_clean":"2024-04-26T21:37:23.007177+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T21:37:23.007177+0000","last_undegraded":"2024-04-26T21:37:23.007177+0000","last_fullsized":"2024-04-26T21:37:23.007177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835847+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T21:37:22.835847+0000","last_peered":"2024-04-26T21:37:22.835847+0000","last_clean":"2024-04-26T21:37:22.835847+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T21:37:22.835847+0000","last_undegraded":"2024-04-26T21:37:22.835847+0000","last_fullsized":"2024-04-26T21:37:22.835847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008689+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T21:37:23.008689+0000","last_peered":"2024-04-26T21:37:23.008689+0000","last_clean":"2024-04-26T21:37:23.008689+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T21:37:23.008689+0000","last_undegraded":"2024-04-26T21:37:23.008689+0000","last_fullsized":"2024-04-26T21:37:23.008689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:36.570146+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T21:37:36.570146+0000","last_peered":"2024-04-26T21:37:36.570146+0000","last_clean":"2024-04-26T21:37:36.570146+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T21:37:36.570146+0000","last_undegraded":"2024-04-26T21:37:36.570146+0000","last_fullsized":"2024-04-26T21:37:36.570146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008785+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T21:37:23.008785+0000","last_peered":"2024-04-26T21:37:23.008785+0000","last_clean":"2024-04-26T21:37:23.008785+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T21:37:23.008785+0000","last_undegraded":"2024-04-26T21:37:23.008785+0000","last_fullsized":"2024-04-26T21:37:23.008785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898450+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T21:37:22.898450+0000","last_peered":"2024-04-26T21:37:22.898450+0000","last_clean":"2024-04-26T21:37:22.898450+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T21:37:22.898450+0000","last_undegraded":"2024-04-26T21:37:22.898450+0000","last_fullsized":"2024-04-26T21:37:22.898450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009035+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T21:37:23.009035+0000","last_peered":"2024-04-26T21:37:23.009035+0000","last_clean":"2024-04-26T21:37:23.009035+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T21:37:23.009035+0000","last_undegraded":"2024-04-26T21:37:23.009035+0000","last_fullsized":"2024-04-26T21:37:23.009035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898445+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T21:37:22.898445+0000","last_peered":"2024-04-26T21:37:22.898445+0000","last_clean":"2024-04-26T21:37:22.898445+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T21:37:22.898445+0000","last_undegraded":"2024-04-26T21:37:22.898445+0000","last_fullsized":"2024-04-26T21:37:22.898445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007383+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T21:37:23.007383+0000","last_peered":"2024-04-26T21:37:23.007383+0000","last_clean":"2024-04-26T21:37:23.007383+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T21:37:23.007383+0000","last_undegraded":"2024-04-26T21:37:23.007383+0000","last_fullsized":"2024-04-26T21:37:23.007383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835976+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T21:37:22.835976+0000","last_peered":"2024-04-26T21:37:22.835976+0000","last_clean":"2024-04-26T21:37:22.835976+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T21:37:22.835976+0000","last_undegraded":"2024-04-26T21:37:22.835976+0000","last_fullsized":"2024-04-26T21:37:22.835976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504073+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T21:37:22.504073+0000","last_peered":"2024-04-26T21:37:22.504073+0000","last_clean":"2024-04-26T21:37:22.504073+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T21:37:22.504073+0000","last_undegraded":"2024-04-26T21:37:22.504073+0000","last_fullsized":"2024-04-26T21:37:22.504073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835637+0000","last_change":"2024-04-26T21:37:17.448137+0000","last_active":"2024-04-26T21:37:22.835637+0000","last_peered":"2024-04-26T21:37:22.835637+0000","last_clean":"2024-04-26T21:37:22.835637+0000","last_became_active":"2024-04-26T21:37:17.447536+0000","last_became_peered":"2024-04-26T21:37:17.447536+0000","last_unstale":"2024-04-26T21:37:22.835637+0000","last_undegraded":"2024-04-26T21:37:22.835637+0000","last_fullsized":"2024-04-26T21:37:22.835637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505128+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T21:37:22.505128+0000","last_peered":"2024-04-26T21:37:22.505128+0000","last_clean":"2024-04-26T21:37:22.505128+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T21:37:22.505128+0000","last_undegraded":"2024-04-26T21:37:22.505128+0000","last_fullsized":"2024-04-26T21:37:22.505128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502604+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T21:37:22.502604+0000","last_peered":"2024-04-26T21:37:22.502604+0000","last_clean":"2024-04-26T21:37:22.502604+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T21:37:22.502604+0000","last_undegraded":"2024-04-26T21:37:22.502604+0000","last_fullsized":"2024-04-26T21:37:22.502604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006466+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T21:37:23.006466+0000","last_peered":"2024-04-26T21:37:23.006466+0000","last_clean":"2024-04-26T21:37:23.006466+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T21:37:23.006466+0000","last_undegraded":"2024-04-26T21:37:23.006466+0000","last_fullsized":"2024-04-26T21:37:23.006466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007668+0000","last_change":"2024-04-26T21:37:17.435754+0000","last_active":"2024-04-26T21:37:23.007668+0000","last_peered":"2024-04-26T21:37:23.007668+0000","last_clean":"2024-04-26T21:37:23.007668+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T21:37:23.007668+0000","last_undegraded":"2024-04-26T21:37:23.007668+0000","last_fullsized":"2024-04-26T21:37:23.007668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834917+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T21:37:22.834917+0000","last_peered":"2024-04-26T21:37:22.834917+0000","last_clean":"2024-04-26T21:37:22.834917+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T21:37:22.834917+0000","last_undegraded":"2024-04-26T21:37:22.834917+0000","last_fullsized":"2024-04-26T21:37:22.834917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504808+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T21:37:22.504808+0000","last_peered":"2024-04-26T21:37:22.504808+0000","last_clean":"2024-04-26T21:37:22.504808+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T21:37:22.504808+0000","last_undegraded":"2024-04-26T21:37:22.504808+0000","last_fullsized":"2024-04-26T21:37:22.504808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502117+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T21:37:22.502117+0000","last_peered":"2024-04-26T21:37:22.502117+0000","last_clean":"2024-04-26T21:37:22.502117+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T21:37:22.502117+0000","last_undegraded":"2024-04-26T21:37:22.502117+0000","last_fullsized":"2024-04-26T21:37:22.502117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502975+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T21:37:22.502975+0000","last_peered":"2024-04-26T21:37:22.502975+0000","last_clean":"2024-04-26T21:37:22.502975+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T21:37:22.502975+0000","last_undegraded":"2024-04-26T21:37:22.502975+0000","last_fullsized":"2024-04-26T21:37:22.502975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504177+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T21:37:22.504177+0000","last_peered":"2024-04-26T21:37:22.504177+0000","last_clean":"2024-04-26T21:37:22.504177+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T21:37:22.504177+0000","last_undegraded":"2024-04-26T21:37:22.504177+0000","last_fullsized":"2024-04-26T21:37:22.504177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007162+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T21:37:23.007162+0000","last_peered":"2024-04-26T21:37:23.007162+0000","last_clean":"2024-04-26T21:37:23.007162+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T21:37:23.007162+0000","last_undegraded":"2024-04-26T21:37:23.007162+0000","last_fullsized":"2024-04-26T21:37:23.007162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506111+0000","last_change":"2024-04-26T21:37:21.495110+0000","last_active":"2024-04-26T21:37:22.506111+0000","last_peered":"2024-04-26T21:37:22.506111+0000","last_clean":"2024-04-26T21:37:22.506111+0000","last_became_active":"2024-04-26T21:37:21.494575+0000","last_became_peered":"2024-04-26T21:37:21.494575+0000","last_unstale":"2024-04-26T21:37:22.506111+0000","last_undegraded":"2024-04-26T21:37:22.506111+0000","last_fullsized":"2024-04-26T21:37:22.506111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:07.156560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503336+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T21:37:22.503336+0000","last_peered":"2024-04-26T21:37:22.503336+0000","last_clean":"2024-04-26T21:37:22.503336+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T21:37:22.503336+0000","last_undegraded":"2024-04-26T21:37:22.503336+0000","last_fullsized":"2024-04-26T21:37:22.503336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897778+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T21:37:22.897778+0000","last_peered":"2024-04-26T21:37:22.897778+0000","last_clean":"2024-04-26T21:37:22.897778+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T21:37:22.897778+0000","last_undegraded":"2024-04-26T21:37:22.897778+0000","last_fullsized":"2024-04-26T21:37:22.897778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503622+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T21:37:22.503622+0000","last_peered":"2024-04-26T21:37:22.503622+0000","last_clean":"2024-04-26T21:37:22.503622+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T21:37:22.503622+0000","last_undegraded":"2024-04-26T21:37:22.503622+0000","last_fullsized":"2024-04-26T21:37:22.503622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503665+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T21:37:22.503665+0000","last_peered":"2024-04-26T21:37:22.503665+0000","last_clean":"2024-04-26T21:37:22.503665+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T21:37:22.503665+0000","last_undegraded":"2024-04-26T21:37:22.503665+0000","last_fullsized":"2024-04-26T21:37:22.503665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505009+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T21:37:22.505009+0000","last_peered":"2024-04-26T21:37:22.505009+0000","last_clean":"2024-04-26T21:37:22.505009+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T21:37:22.505009+0000","last_undegraded":"2024-04-26T21:37:22.505009+0000","last_fullsized":"2024-04-26T21:37:22.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:06.431151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835356+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T21:37:22.835356+0000","last_peered":"2024-04-26T21:37:22.835356+0000","last_clean":"2024-04-26T21:37:22.835356+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T21:37:22.835356+0000","last_undegraded":"2024-04-26T21:37:22.835356+0000","last_fullsized":"2024-04-26T21:37:22.835356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006871+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T21:37:23.006871+0000","last_peered":"2024-04-26T21:37:23.006871+0000","last_clean":"2024-04-26T21:37:23.006871+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T21:37:23.006871+0000","last_undegraded":"2024-04-26T21:37:23.006871+0000","last_fullsized":"2024-04-26T21:37:23.006871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504606+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T21:37:22.504606+0000","last_peered":"2024-04-26T21:37:22.504606+0000","last_clean":"2024-04-26T21:37:22.504606+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T21:37:22.504606+0000","last_undegraded":"2024-04-26T21:37:22.504606+0000","last_fullsized":"2024-04-26T21:37:22.504606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008708+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T21:37:23.008708+0000","last_peered":"2024-04-26T21:37:23.008708+0000","last_clean":"2024-04-26T21:37:23.008708+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T21:37:23.008708+0000","last_undegraded":"2024-04-26T21:37:23.008708+0000","last_fullsized":"2024-04-26T21:37:23.008708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505315+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T21:37:22.505315+0000","last_peered":"2024-04-26T21:37:22.505315+0000","last_clean":"2024-04-26T21:37:22.505315+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T21:37:22.505315+0000","last_undegraded":"2024-04-26T21:37:22.505315+0000","last_fullsized":"2024-04-26T21:37:22.505315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503899+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T21:37:22.503899+0000","last_peered":"2024-04-26T21:37:22.503899+0000","last_clean":"2024-04-26T21:37:22.503899+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T21:37:22.503899+0000","last_undegraded":"2024-04-26T21:37:22.503899+0000","last_fullsized":"2024-04-26T21:37:22.503899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834911+0000","last_change":"2024-04-26T21:37:17.444705+0000","last_active":"2024-04-26T21:37:22.834911+0000","last_peered":"2024-04-26T21:37:22.834911+0000","last_clean":"2024-04-26T21:37:22.834911+0000","last_became_active":"2024-04-26T21:37:17.443677+0000","last_became_peered":"2024-04-26T21:37:17.443677+0000","last_unstale":"2024-04-26T21:37:22.834911+0000","last_undegraded":"2024-04-26T21:37:22.834911+0000","last_fullsized":"2024-04-26T21:37:22.834911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502478+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T21:37:22.502478+0000","last_peered":"2024-04-26T21:37:22.502478+0000","last_clean":"2024-04-26T21:37:22.502478+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T21:37:22.502478+0000","last_undegraded":"2024-04-26T21:37:22.502478+0000","last_fullsized":"2024-04-26T21:37:22.502478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834945+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T21:37:22.834945+0000","last_peered":"2024-04-26T21:37:22.834945+0000","last_clean":"2024-04-26T21:37:22.834945+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T21:37:22.834945+0000","last_undegraded":"2024-04-26T21:37:22.834945+0000","last_fullsized":"2024-04-26T21:37:22.834945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006311+0000","last_change":"2024-04-26T21:37:17.439778+0000","last_active":"2024-04-26T21:37:23.006311+0000","last_peered":"2024-04-26T21:37:23.006311+0000","last_clean":"2024-04-26T21:37:23.006311+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T21:37:23.006311+0000","last_undegraded":"2024-04-26T21:37:23.006311+0000","last_fullsized":"2024-04-26T21:37:23.006311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505241+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T21:37:22.505241+0000","last_peered":"2024-04-26T21:37:22.505241+0000","last_clean":"2024-04-26T21:37:22.505241+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T21:37:22.505241+0000","last_undegraded":"2024-04-26T21:37:22.505241+0000","last_fullsized":"2024-04-26T21:37:22.505241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009389+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T21:37:23.009389+0000","last_peered":"2024-04-26T21:37:23.009389+0000","last_clean":"2024-04-26T21:37:23.009389+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T21:37:23.009389+0000","last_undegraded":"2024-04-26T21:37:23.009389+0000","last_fullsized":"2024-04-26T21:37:23.009389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506334+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T21:37:22.506334+0000","last_peered":"2024-04-26T21:37:22.506334+0000","last_clean":"2024-04-26T21:37:22.506334+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T21:37:22.506334+0000","last_undegraded":"2024-04-26T21:37:22.506334+0000","last_fullsized":"2024-04-26T21:37:22.506334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:34.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836379+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T21:37:22.836379+0000","last_peered":"2024-04-26T21:37:22.836379+0000","last_clean":"2024-04-26T21:37:22.836379+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T21:37:22.836379+0000","last_undegraded":"2024-04-26T21:37:22.836379+0000","last_fullsized":"2024-04-26T21:37:22.836379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834542+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T21:37:22.834542+0000","last_peered":"2024-04-26T21:37:22.834542+0000","last_clean":"2024-04-26T21:37:22.834542+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T21:37:22.834542+0000","last_undegraded":"2024-04-26T21:37:22.834542+0000","last_fullsized":"2024-04-26T21:37:22.834542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007729+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T21:37:23.007729+0000","last_peered":"2024-04-26T21:37:23.007729+0000","last_clean":"2024-04-26T21:37:23.007729+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T21:37:23.007729+0000","last_undegraded":"2024-04-26T21:37:23.007729+0000","last_fullsized":"2024-04-26T21:37:23.007729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005927+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T21:37:23.005927+0000","last_peered":"2024-04-26T21:37:23.005927+0000","last_clean":"2024-04-26T21:37:23.005927+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T21:37:23.005927+0000","last_undegraded":"2024-04-26T21:37:23.005927+0000","last_fullsized":"2024-04-26T21:37:23.005927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:38.335510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502794+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T21:37:22.502794+0000","last_peered":"2024-04-26T21:37:22.502794+0000","last_clean":"2024-04-26T21:37:22.502794+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T21:37:22.502794+0000","last_undegraded":"2024-04-26T21:37:22.502794+0000","last_fullsized":"2024-04-26T21:37:22.502794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898187+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T21:37:22.898187+0000","last_peered":"2024-04-26T21:37:22.898187+0000","last_clean":"2024-04-26T21:37:22.898187+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T21:37:22.898187+0000","last_undegraded":"2024-04-26T21:37:22.898187+0000","last_fullsized":"2024-04-26T21:37:22.898187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504907+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T21:37:22.504907+0000","last_peered":"2024-04-26T21:37:22.504907+0000","last_clean":"2024-04-26T21:37:22.504907+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T21:37:22.504907+0000","last_undegraded":"2024-04-26T21:37:22.504907+0000","last_fullsized":"2024-04-26T21:37:22.504907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505211+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T21:37:22.505211+0000","last_peered":"2024-04-26T21:37:22.505211+0000","last_clean":"2024-04-26T21:37:22.505211+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T21:37:22.505211+0000","last_undegraded":"2024-04-26T21:37:22.505211+0000","last_fullsized":"2024-04-26T21:37:22.505211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009791+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T21:37:23.009791+0000","last_peered":"2024-04-26T21:37:23.009791+0000","last_clean":"2024-04-26T21:37:23.009791+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T21:37:23.009791+0000","last_undegraded":"2024-04-26T21:37:23.009791+0000","last_fullsized":"2024-04-26T21:37:23.009791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501800+0000","last_change":"2024-04-26T21:37:17.446605+0000","last_active":"2024-04-26T21:37:22.501800+0000","last_peered":"2024-04-26T21:37:22.501800+0000","last_clean":"2024-04-26T21:37:22.501800+0000","last_became_active":"2024-04-26T21:37:17.446226+0000","last_became_peered":"2024-04-26T21:37:17.446226+0000","last_unstale":"2024-04-26T21:37:22.501800+0000","last_undegraded":"2024-04-26T21:37:22.501800+0000","last_fullsized":"2024-04-26T21:37:22.501800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007819+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T21:37:23.007819+0000","last_peered":"2024-04-26T21:37:23.007819+0000","last_clean":"2024-04-26T21:37:23.007819+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T21:37:23.007819+0000","last_undegraded":"2024-04-26T21:37:23.007819+0000","last_fullsized":"2024-04-26T21:37:23.007819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834855+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T21:37:22.834855+0000","last_peered":"2024-04-26T21:37:22.834855+0000","last_clean":"2024-04-26T21:37:22.834855+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T21:37:22.834855+0000","last_undegraded":"2024-04-26T21:37:22.834855+0000","last_fullsized":"2024-04-26T21:37:22.834855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008305+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T21:37:23.008305+0000","last_peered":"2024-04-26T21:37:23.008305+0000","last_clean":"2024-04-26T21:37:23.008305+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T21:37:23.008305+0000","last_undegraded":"2024-04-26T21:37:23.008305+0000","last_fullsized":"2024-04-26T21:37:23.008305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835990+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T21:37:22.835990+0000","last_peered":"2024-04-26T21:37:22.835990+0000","last_clean":"2024-04-26T21:37:22.835990+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T21:37:22.835990+0000","last_undegraded":"2024-04-26T21:37:22.835990+0000","last_fullsized":"2024-04-26T21:37:22.835990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006647+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T21:37:23.006647+0000","last_peered":"2024-04-26T21:37:23.006647+0000","last_clean":"2024-04-26T21:37:23.006647+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T21:37:23.006647+0000","last_undegraded":"2024-04-26T21:37:23.006647+0000","last_fullsized":"2024-04-26T21:37:23.006647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009135+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T21:37:23.009135+0000","last_peered":"2024-04-26T21:37:23.009135+0000","last_clean":"2024-04-26T21:37:23.009135+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T21:37:23.009135+0000","last_undegraded":"2024-04-26T21:37:23.009135+0000","last_fullsized":"2024-04-26T21:37:23.009135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009638+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T21:37:23.009638+0000","last_peered":"2024-04-26T21:37:23.009638+0000","last_clean":"2024-04-26T21:37:23.009638+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T21:37:23.009638+0000","last_undegraded":"2024-04-26T21:37:23.009638+0000","last_fullsized":"2024-04-26T21:37:23.009638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:37:41.585 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T21:37:41.585 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T21:37:41.586 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T21:37:41.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T21:37:41.586 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T21:37:41.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.831+0000 7f4456a00640 1 Processor -- start 2024-04-26T21:37:41.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.831+0000 7f4456a00640 1 -- start start 2024-04-26T21:37:41.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.832+0000 7f4456a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44500b68f0 0x7f44500b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.832+0000 7f4456a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44500b5e00 con 0x7f4450142b70 2024-04-26T21:37:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.832+0000 7f4456a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44500b4bf0 con 0x7f445014bb70 2024-04-26T21:37:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.832+0000 7f4456a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f445014bfe0 con 0x7f44500b68f0 2024-04-26T21:37:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.833+0000 7f444fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44500b68f0 0x7f44500b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.833+0000 7f444fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44500b68f0 0x7f44500b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49306/0 (socket says 172.21.15.5:49306) 2024-04-26T21:37:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.833+0000 7f444fe00640 1 -- 172.21.15.5:0/3471546017 learned_addr learned my addr 172.21.15.5:0/3471546017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.833+0000 7f444fe00640 1 -- 172.21.15.5:0/3471546017 >> v1:172.21.15.112:6789/0 conn(0x7f445014bb70 legacy=0x7f4450142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.833+0000 7f444fe00640 1 -- 172.21.15.5:0/3471546017 >> v1:172.21.15.5:6789/0 conn(0x7f4450142b70 legacy=0x7f4450152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.833+0000 7f444fe00640 1 -- 172.21.15.5:0/3471546017 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44500b6cd0 con 0x7f44500b68f0 2024-04-26T21:37:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.834+0000 7f444fe00640 1 --2- 172.21.15.5:0/3471546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44500b68f0 0x7f44500b5770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4440009e50 tx=0x7f444002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76bba15455fe61d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.834+0000 7f444ea00640 1 -- 172.21.15.5:0/3471546017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440036070 con 0x7f44500b68f0 2024-04-26T21:37:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f444ea00640 1 -- 172.21.15.5:0/3471546017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4440031600 con 0x7f44500b68f0 2024-04-26T21:37:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f444ea00640 1 -- 172.21.15.5:0/3471546017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44400319d0 con 0x7f44500b68f0 2024-04-26T21:37:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f4456a00640 1 -- 172.21.15.5:0/3471546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44500b68f0 msgr2=0x7f44500b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f4456a00640 1 --2- 172.21.15.5:0/3471546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44500b68f0 0x7f44500b5770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4440009e50 tx=0x7f444002a6d0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f4456a00640 1 -- 172.21.15.5:0/3471546017 shutdown_connections 2024-04-26T21:37:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f4456a00640 1 --2- 172.21.15.5:0/3471546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44500b68f0 0x7f44500b5770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f4456a00640 1 -- 172.21.15.5:0/3471546017 >> 172.21.15.5:0/3471546017 conn(0x7f4450068480 msgr2=0x7f4450068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f4456a00640 1 -- 172.21.15.5:0/3471546017 shutdown_connections 2024-04-26T21:37:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.835+0000 7f4456a00640 1 -- 172.21.15.5:0/3471546017 wait complete. 2024-04-26T21:37:41.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.837+0000 7f4456a00640 1 Processor -- start 2024-04-26T21:37:41.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.837+0000 7f4456a00640 1 -- start start 2024-04-26T21:37:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4456a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44500b68f0 0x7f44500bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4456a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4450142b70 0x7f44500bc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4456a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f445014bb70 0x7f44501de470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4456a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f44500bb330 con 0x7f445014bb70 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4456a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44500b7e80 con 0x7f44500b68f0 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4456a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f44500bb580 con 0x7f4450142b70 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4454a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f445014bb70 0x7f44501de470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4454a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f445014bb70 0x7f44501de470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49314/0 (socket says 172.21.15.5:49314) 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f4454a00640 1 -- 172.21.15.5:0/2435495733 learned_addr learned my addr 172.21.15.5:0/2435495733 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f444fe00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44500b68f0 0x7f44500bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.838+0000 7f444f400640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4450142b70 0x7f44500bc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4454a00640 1 -- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4450142b70 msgr2=0x7f44500bc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4454a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4450142b70 0x7f44500bc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4454a00640 1 -- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44500b68f0 msgr2=0x7f44500bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4454a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44500b68f0 0x7f44500bcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4454a00640 1 -- 172.21.15.5:0/2435495733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44500be9f0 con 0x7f445014bb70 2024-04-26T21:37:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f444f400640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4450142b70 0x7f44500bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4454a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f445014bb70 0x7f44501de470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f444800c3a0 tx=0x7f444800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4447e00640 1 -- 172.21.15.5:0/2435495733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448017070 con 0x7f445014bb70 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4447e00640 1 -- 172.21.15.5:0/2435495733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44480052d0 con 0x7f445014bb70 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4447e00640 1 -- 172.21.15.5:0/2435495733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448003830 con 0x7f445014bb70 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4450145f00 con 0x7f445014bb70 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.839+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44500be710 con 0x7f445014bb70 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.841+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44500bc020 con 0x7f445014bb70 2024-04-26T21:37:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.841+0000 7f4447e00640 1 -- 172.21.15.5:0/2435495733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f444801a070 con 0x7f445014bb70 2024-04-26T21:37:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.842+0000 7f4447e00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f442c06c8f0 0x7f442c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.842+0000 7f4447e00640 1 -- 172.21.15.5:0/2435495733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f444808b190 con 0x7f445014bb70 2024-04-26T21:37:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.843+0000 7f444fe00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f442c06c8f0 0x7f442c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.844+0000 7f444fe00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f442c06c8f0 0x7f442c06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4440033000 tx=0x7f4440009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:41.846+0000 7f4447e00640 1 -- 172.21.15.5:0/2435495733 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4448059330 con 0x7f445014bb70 2024-04-26T21:37:42.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.092+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4450075db0 con 0x7f445014bb70 2024-04-26T21:37:42.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.096+0000 7f4447e00640 1 -- 172.21.15.5:0/2435495733 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7f4448058c30 con 0x7f445014bb70 2024-04-26T21:37:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f442c06c8f0 msgr2=0x7f442c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f442c06c8f0 0x7f442c06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4440033000 tx=0x7f4440009000 comp rx=0 tx=0).stop 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f445014bb70 msgr2=0x7f44501de470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f445014bb70 0x7f44501de470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f444800c3a0 tx=0x7f444800c860 comp rx=0 tx=0).stop 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 shutdown_connections 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f442c06c8f0 0x7f442c06edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f445014bb70 0x7f44501de470 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4450142b70 0x7f44500bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 --2- 172.21.15.5:0/2435495733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44500b68f0 0x7f44500bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 >> 172.21.15.5:0/2435495733 conn(0x7f4450068480 msgr2=0x7f4450068860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 shutdown_connections 2024-04-26T21:37:42.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.100+0000 7f4456a00640 1 -- 172.21.15.5:0/2435495733 wait complete. 2024-04-26T21:37:42.125 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2672338158},{"type":"v1","addr":"172.21.15.112:6833","nonce":2672338158}]},"active_addr":"172.21.15.112:6833/2672338158","active_change":"2024-04-26T21:36:57.421128+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1051257374}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3541942627}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":206125167}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3427496092}]}]} 2024-04-26T21:37:42.130 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T21:37:42.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T21:37:42.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.338+0000 7fdfcb400640 1 Processor -- start 2024-04-26T21:37:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.339+0000 7fdfcb400640 1 -- start start 2024-04-26T21:37:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.340+0000 7fdfcb400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdfc40b6d50 0x7fdfc40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.340+0000 7fdfcb400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41494e0 0x7fdfc414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.340+0000 7fdfcb400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc40b7130 con 0x7fdfc414bcc0 2024-04-26T21:37:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.340+0000 7fdfcb400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc40b0070 con 0x7fdfc40b6d50 2024-04-26T21:37:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.340+0000 7fdfcb400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc40af490 con 0x7fdfc41494e0 2024-04-26T21:37:42.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.341+0000 7fdfc8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdfc40b6d50 0x7fdfc40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.341+0000 7fdfc8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdfc40b6d50 0x7fdfc40b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53892/0 (socket says 172.21.15.5:53892) 2024-04-26T21:37:42.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.341+0000 7fdfc8a00640 1 -- 172.21.15.5:0/2857298972 learned_addr learned my addr 172.21.15.5:0/2857298972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:42.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.341+0000 7fdfc9400640 1 --2- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41494e0 0x7fdfc414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.341+0000 7fdfc8a00640 1 -- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41494e0 msgr2=0x7fdfc414c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.341+0000 7fdfc8a00640 1 --2- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41494e0 0x7fdfc414c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.342+0000 7fdfc8a00640 1 -- 172.21.15.5:0/2857298972 >> v1:172.21.15.112:6789/0 conn(0x7fdfc414bcc0 legacy=0x7fdfc4148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.342+0000 7fdfc8a00640 1 -- 172.21.15.5:0/2857298972 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc40aec60 con 0x7fdfc40b6d50 2024-04-26T21:37:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.343+0000 7fdfc8a00640 1 --2- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc40b6d50 0x7fdfc40b07a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009870 tx=0x7fdfb802a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=472517b00bd93873 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.343+0000 7fdfc3400640 1 -- 172.21.15.5:0/2857298972 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8037070 con 0x7fdfc40b6d50 2024-04-26T21:37:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.343+0000 7fdfc3400640 1 -- 172.21.15.5:0/2857298972 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb8032440 con 0x7fdfc40b6d50 2024-04-26T21:37:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.343+0000 7fdfc3400640 1 -- 172.21.15.5:0/2857298972 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8032810 con 0x7fdfc40b6d50 2024-04-26T21:37:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 -- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc40b6d50 msgr2=0x7fdfc40b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 --2- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc40b6d50 0x7fdfc40b07a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009870 tx=0x7fdfb802a140 comp rx=0 tx=0).stop 2024-04-26T21:37:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 -- 172.21.15.5:0/2857298972 shutdown_connections 2024-04-26T21:37:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 --2- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41494e0 0x7fdfc414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 --2- 172.21.15.5:0/2857298972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc40b6d50 0x7fdfc40b07a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 -- 172.21.15.5:0/2857298972 >> 172.21.15.5:0/2857298972 conn(0x7fdfc406c720 msgr2=0x7fdfc406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 -- 172.21.15.5:0/2857298972 shutdown_connections 2024-04-26T21:37:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.344+0000 7fdfcb400640 1 -- 172.21.15.5:0/2857298972 wait complete. 2024-04-26T21:37:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.346+0000 7fdfcb400640 1 Processor -- start 2024-04-26T21:37:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.346+0000 7fdfcb400640 1 -- start start 2024-04-26T21:37:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfcb400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc40b6d50 0x7fdfc41e17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfcb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc41494e0 0x7fdfc41424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfcb400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc414bcc0 0x7fdfc41479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfcb400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc40ae990 con 0x7fdfc41494e0 2024-04-26T21:37:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfcb400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc40ae810 con 0x7fdfc414bcc0 2024-04-26T21:37:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfcb400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc4152ff0 con 0x7fdfc40b6d50 2024-04-26T21:37:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc41494e0 0x7fdfc41424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc41494e0 0x7fdfc41424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49320/0 (socket says 172.21.15.5:49320) 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfc3e00640 1 -- 172.21.15.5:0/974305832 learned_addr learned my addr 172.21.15.5:0/974305832 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.347+0000 7fdfc8a00640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc40b6d50 0x7fdfc41e17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.348+0000 7fdfc9400640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc414bcc0 0x7fdfc41479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.348+0000 7fdfc3e00640 1 -- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc40b6d50 msgr2=0x7fdfc41e17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.348+0000 7fdfc3e00640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc40b6d50 0x7fdfc41e17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.348+0000 7fdfc3e00640 1 -- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc414bcc0 msgr2=0x7fdfc41479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.348+0000 7fdfc3e00640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc414bcc0 0x7fdfc41479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.348+0000 7fdfc3e00640 1 -- 172.21.15.5:0/974305832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc4070650 con 0x7fdfc41494e0 2024-04-26T21:37:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.348+0000 7fdfc3e00640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc41494e0 0x7fdfc41424a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c3c0 tx=0x7fdfb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.349+0000 7fdfc0c00640 1 -- 172.21.15.5:0/974305832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00052d0 con 0x7fdfc41494e0 2024-04-26T21:37:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.349+0000 7fdfc0c00640 1 -- 172.21.15.5:0/974305832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb0005490 con 0x7fdfc41494e0 2024-04-26T21:37:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.349+0000 7fdfc0c00640 1 -- 172.21.15.5:0/974305832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0007260 con 0x7fdfc41494e0 2024-04-26T21:37:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.349+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc41474d0 con 0x7fdfc41494e0 2024-04-26T21:37:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.349+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc40b07a0 con 0x7fdfc41494e0 2024-04-26T21:37:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.350+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc4075db0 con 0x7fdfc41494e0 2024-04-26T21:37:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.351+0000 7fdfc0c00640 1 -- 172.21.15.5:0/974305832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfb0007400 con 0x7fdfc41494e0 2024-04-26T21:37:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.352+0000 7fdfc0c00640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdfa406c920 0x7fdfa406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.352+0000 7fdfc0c00640 1 -- 172.21.15.5:0/974305832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdfb008b250 con 0x7fdfc41494e0 2024-04-26T21:37:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.353+0000 7fdfc8a00640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdfa406c920 0x7fdfa406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.354+0000 7fdfc8a00640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdfa406c920 0x7fdfa406ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8034000 tx=0x7fdfb802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:42.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.362+0000 7fdfc0c00640 1 -- 172.21.15.5:0/974305832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdfc4070650 con 0x7fdfc41494e0 2024-04-26T21:37:42.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.567+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfc40b1a90 con 0x7fdfc41494e0 2024-04-26T21:37:42.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.569+0000 7fdfc0c00640 1 -- 172.21.15.5:0/974305832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7fdfb0058d80 con 0x7fdfc41494e0 2024-04-26T21:37:42.570 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:42.570 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.571+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdfa406c920 msgr2=0x7fdfa406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.571+0000 7fdfcb400640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdfa406c920 0x7fdfa406ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8034000 tx=0x7fdfb802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.571+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc41494e0 msgr2=0x7fdfc41424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.571+0000 7fdfcb400640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc41494e0 0x7fdfc41424a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c3c0 tx=0x7fdfb000c880 comp rx=0 tx=0).stop 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 shutdown_connections 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc414bcc0 0x7fdfc41479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdfa406c920 0x7fdfa406ede0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc41494e0 0x7fdfc41424a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 --2- 172.21.15.5:0/974305832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc40b6d50 0x7fdfc41e17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 >> 172.21.15.5:0/974305832 conn(0x7fdfc406c720 msgr2=0x7fdfc40b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 shutdown_connections 2024-04-26T21:37:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.572+0000 7fdfcb400640 1 -- 172.21.15.5:0/974305832 wait complete. 2024-04-26T21:37:42.591 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T21:37:42.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.774+0000 7fda1ea00640 1 Processor -- start 2024-04-26T21:37:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.774+0000 7fda1ea00640 1 -- start start 2024-04-26T21:37:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.775+0000 7fda1ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 0x7fda180b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.775+0000 7fda1ea00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda180b5e00 con 0x7fda18142b70 2024-04-26T21:37:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.775+0000 7fda1ea00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda180b4bf0 con 0x7fda1814bb70 2024-04-26T21:37:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.775+0000 7fda1ea00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fda180b7e80 con 0x7fda180b68f0 2024-04-26T21:37:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda1ca00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda18142b70 0x7fda18152ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56146/0 (socket says 172.21.15.5:56146) 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda1ca00640 1 -- 172.21.15.5:0/394251159 learned_addr learned my addr 172.21.15.5:0/394251159 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda17e00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 0x7fda180b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341501508 0 0) 0x7fda180b5e00 con 0x7fda18142b70 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9fc003520 con 0x7fda18142b70 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708906104 0 0) 0x7fd9fc003520 con 0x7fda18142b70 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 msgr2=0x7fda180b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda17400640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 0x7fda180b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.776+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 >> v1:172.21.15.112:6789/0 conn(0x7fda1814bb70 legacy=0x7fda18142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda180b6cd0 con 0x7fda18142b70 2024-04-26T21:37:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fda100019f0 con 0x7fda18142b70 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 >> v1:172.21.15.5:6789/0 conn(0x7fda18142b70 legacy=0x7fda18152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc0039e0 0x7fd9fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9fc004800 0x7fd9fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 0x7fd9fc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda180b7e80 con 0x7fd9fc004800 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc00baf0 con 0x7fd9fc0039e0 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc00bcf0 con 0x7fda180b68f0 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda0fe00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9fc004800 0x7fd9fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda17e00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc0039e0 0x7fd9fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.777+0000 7fda1ca00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 0x7fd9fc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.778+0000 7fda0fe00640 1 -- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 msgr2=0x7fd9fc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.778+0000 7fda0fe00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda180b68f0 0x7fd9fc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.778+0000 7fda0fe00640 1 -- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc0039e0 msgr2=0x7fd9fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.778+0000 7fda0fe00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc0039e0 0x7fd9fc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.778+0000 7fda0fe00640 1 -- 172.21.15.5:0/394251159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc003520 con 0x7fd9fc004800 2024-04-26T21:37:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.779+0000 7fda0fe00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9fc004800 0x7fd9fc004c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda00001750 tx=0x7fd9fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6313e2abd0f760a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.779+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00001370 con 0x7fd9fc004800 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.779+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda000052d0 con 0x7fd9fc004800 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.779+0000 7fda17400640 1 -- 172.21.15.5:0/394251159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0002abe0 con 0x7fd9fc004800 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.779+0000 7fda1ea00640 1 -- 172.21.15.5:0/394251159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9fc004800 msgr2=0x7fd9fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.779+0000 7fda1ea00640 1 --2- 172.21.15.5:0/394251159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9fc004800 0x7fd9fc004c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda00001750 tx=0x7fd9fc005830 comp rx=0 tx=0).stop 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.779+0000 7fda1ca00640 1 -- 172.21.15.5:0/394251159 reap_dead start 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.780+0000 7fda1ea00640 1 -- 172.21.15.5:0/394251159 shutdown_connections 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.780+0000 7fda1ea00640 1 -- 172.21.15.5:0/394251159 >> 172.21.15.5:0/394251159 conn(0x7fda18068480 msgr2=0x7fda18068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.780+0000 7fda1ea00640 1 -- 172.21.15.5:0/394251159 shutdown_connections 2024-04-26T21:37:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.780+0000 7fda1ea00640 1 -- 172.21.15.5:0/394251159 wait complete. 2024-04-26T21:37:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.782+0000 7fda1ea00640 1 Processor -- start 2024-04-26T21:37:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.782+0000 7fda1ea00640 1 -- start start 2024-04-26T21:37:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc004800 0x7fda18142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda18143310 0x7fda181445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18143770 0x7fda181e1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda180bb580 con 0x7fda18143770 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fda180bb330 con 0x7fd9fc004800 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ea00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fda180b52e0 con 0x7fda18143310 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18143770 0x7fda181e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18143770 0x7fda181e1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49340/0 (socket says 172.21.15.5:49340) 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 -- 172.21.15.5:0/427544860 learned_addr learned my addr 172.21.15.5:0/427544860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda0fe00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda18143310 0x7fda181445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda17e00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc004800 0x7fda18142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 -- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda18143310 msgr2=0x7fda181445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda18143310 0x7fda181445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 -- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc004800 msgr2=0x7fda18142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc004800 0x7fda18142150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.784+0000 7fda1ca00640 1 -- 172.21.15.5:0/427544860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda18145070 con 0x7fda18143770 2024-04-26T21:37:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.785+0000 7fda1ca00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18143770 0x7fda181e1140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc004780 tx=0x7fda1000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.785+0000 7fda14c00640 1 -- 172.21.15.5:0/427544860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1000ec10 con 0x7fda18143770 2024-04-26T21:37:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.785+0000 7fda14c00640 1 -- 172.21.15.5:0/427544860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1000edd0 con 0x7fda18143770 2024-04-26T21:37:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.785+0000 7fda14c00640 1 -- 172.21.15.5:0/427544860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10014670 con 0x7fda18143770 2024-04-26T21:37:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.785+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda18145910 con 0x7fda18143770 2024-04-26T21:37:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.785+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda18146110 con 0x7fda18143770 2024-04-26T21:37:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.786+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda18075db0 con 0x7fda18143770 2024-04-26T21:37:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.787+0000 7fda14c00640 1 -- 172.21.15.5:0/427544860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda10014810 con 0x7fda18143770 2024-04-26T21:37:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.788+0000 7fda14c00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd9f406c8f0 0x7fd9f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.788+0000 7fda14c00640 1 -- 172.21.15.5:0/427544860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda1008bd20 con 0x7fda18143770 2024-04-26T21:37:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.789+0000 7fda17e00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd9f406c8f0 0x7fd9f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:42.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.790+0000 7fda17e00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd9f406c8f0 0x7fd9f406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda08009950 tx=0x7fda08008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:42.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.792+0000 7fda14c00640 1 -- 172.21.15.5:0/427544860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda10059ec0 con 0x7fda18143770 2024-04-26T21:37:42.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:37:42.992 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:37:42.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.991+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda180bcc20 con 0x7fda18143770 2024-04-26T21:37:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.994+0000 7fda14c00640 1 -- 172.21.15.5:0/427544860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7fda100597c0 con 0x7fda18143770 2024-04-26T21:37:42.994 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:42.994 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.996+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd9f406c8f0 msgr2=0x7fd9f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.996+0000 7fda1ea00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd9f406c8f0 0x7fd9f406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda08009950 tx=0x7fda08008040 comp rx=0 tx=0).stop 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.996+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18143770 msgr2=0x7fda181e1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.996+0000 7fda1ea00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18143770 0x7fda181e1140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc004780 tx=0x7fda1000e530 comp rx=0 tx=0).stop 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.996+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 shutdown_connections 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.996+0000 7fda1ea00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd9f406c8f0 0x7fd9f406edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.997+0000 7fda1ea00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18143770 0x7fda181e1140 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.997+0000 7fda1ea00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda18143310 0x7fda181445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.997+0000 7fda1ea00640 1 --2- 172.21.15.5:0/427544860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9fc004800 0x7fda18142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.997+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 >> 172.21.15.5:0/427544860 conn(0x7fda18068480 msgr2=0x7fda180bde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.997+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 shutdown_connections 2024-04-26T21:37:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:42.997+0000 7fda1ea00640 1 -- 172.21.15.5:0/427544860 wait complete. 2024-04-26T21:37:43.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T21:37:43.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T21:37:43.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T21:37:43.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T21:37:43.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T21:37:43.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T21:37:43.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T21:37:43.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T21:37:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.365+0000 7f4f49a00640 1 Processor -- start 2024-04-26T21:37:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.365+0000 7f4f49a00640 1 -- start start 2024-04-26T21:37:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.367+0000 7f4f49a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f4406e630 0x7f4f440b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.367+0000 7f4f49a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f440739d0 0x7f4f44147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.367+0000 7f4f49a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4406ea10 con 0x7f4f44073e30 2024-04-26T21:37:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.367+0000 7f4f49a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4f440b0b80 con 0x7f4f440739d0 2024-04-26T21:37:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.367+0000 7f4f49a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4406f110 con 0x7f4f4406e630 2024-04-26T21:37:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.368+0000 7f4f42000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f440739d0 0x7f4f44147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.369+0000 7f4f42a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f4406e630 0x7f4f440b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.369+0000 7f4f42000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f440739d0 0x7f4f44147cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49350/0 (socket says 172.21.15.5:49350) 2024-04-26T21:37:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.369+0000 7f4f42000640 1 -- 172.21.15.5:0/3566940587 learned_addr learned my addr 172.21.15.5:0/3566940587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.370+0000 7f4f42000640 1 -- 172.21.15.5:0/3566940587 >> v2:172.21.15.112:3300/0 conn(0x7f4f4406e630 msgr2=0x7f4f440b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.370+0000 7f4f42000640 1 --2- 172.21.15.5:0/3566940587 >> v2:172.21.15.112:3300/0 conn(0x7f4f4406e630 0x7f4f440b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.370+0000 7f4f42000640 1 -- 172.21.15.5:0/3566940587 >> v1:172.21.15.112:6789/0 conn(0x7f4f44073e30 legacy=0x7f4f44148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.370+0000 7f4f42000640 1 -- 172.21.15.5:0/3566940587 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f440b1630 con 0x7f4f440739d0 2024-04-26T21:37:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.374+0000 7f5291400640 1 Processor -- start 2024-04-26T21:37:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.374+0000 7f5291400640 1 -- start start 2024-04-26T21:37:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5291400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c06ca30 0x7f528c06e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5291400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f528c0738a0 0x7f528c0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5291400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c0b12c0 con 0x7f528c0b0a80 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5291400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f528c0b0ec0 con 0x7f528c0738a0 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5289e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f528c0738a0 0x7f528c0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5291400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f528c06ce10 con 0x7f528c06ca30 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5289e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f528c0738a0 0x7f528c0b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49356/0 (socket says 172.21.15.5:49356) 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f5289e00640 1 -- 172.21.15.5:0/1380669033 learned_addr learned my addr 172.21.15.5:0/1380669033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.376+0000 7f4f42000640 1 --2- 172.21.15.5:0/3566940587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f440739d0 0x7f4f44147cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f440bac80 tx=0x7f4f3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e29f034ce0b40f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.377+0000 7f4f41600640 1 -- 172.21.15.5:0/3566940587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34037070 con 0x7f4f440739d0 2024-04-26T21:37:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.378+0000 7f4f41600640 1 -- 172.21.15.5:0/3566940587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3402ae20 con 0x7f4f440739d0 2024-04-26T21:37:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.378+0000 7f4f41600640 1 -- 172.21.15.5:0/3566940587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34032660 con 0x7f4f440739d0 2024-04-26T21:37:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.378+0000 7f1517600640 1 Processor -- start 2024-04-26T21:37:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.378+0000 7f528a800640 1 --2- 172.21.15.5:0/1380669033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c06ca30 0x7f528c06e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.378+0000 7f1517600640 1 -- start start 2024-04-26T21:37:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.380+0000 7f1517600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080caf30 0x7f15080dc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.379+0000 7f528a800640 1 -- 172.21.15.5:0/1380669033 >> v2:172.21.15.5:3300/0 conn(0x7f528c0738a0 msgr2=0x7f528c0b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.379+0000 7f528a800640 1 --2- 172.21.15.5:0/1380669033 >> v2:172.21.15.5:3300/0 conn(0x7f528c0738a0 0x7f528c0b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.379+0000 7f528a800640 1 -- 172.21.15.5:0/1380669033 >> v1:172.21.15.112:6789/0 conn(0x7f528c0b0a80 legacy=0x7f528c1500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.379+0000 7f528a800640 1 -- 172.21.15.5:0/1380669033 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c06d0c0 con 0x7f528c06ca30 2024-04-26T21:37:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.380+0000 7f1517600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1508037040 con 0x7f1508008c90 2024-04-26T21:37:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.380+0000 7f1517600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1508009070 con 0x7f15080097f0 2024-04-26T21:37:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.380+0000 7f1517600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f15080d0f30 con 0x7f15080caf30 2024-04-26T21:37:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.380+0000 7f4f49a00640 1 -- 172.21.15.5:0/3566940587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f440739d0 msgr2=0x7f4f44147cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.380+0000 7f5289e00640 1 --2- 172.21.15.5:0/1380669033 >> v2:172.21.15.5:3300/0 conn(0x7f528c0738a0 0x7f528c0b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:37:43.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.380+0000 7f4f49a00640 1 --2- 172.21.15.5:0/3566940587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f440739d0 0x7f4f44147cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f440bac80 tx=0x7f4f3402a110 comp rx=0 tx=0).stop 2024-04-26T21:37:43.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.381+0000 7f4f49a00640 1 -- 172.21.15.5:0/3566940587 shutdown_connections 2024-04-26T21:37:43.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.381+0000 7f4f49a00640 1 --2- 172.21.15.5:0/3566940587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f440739d0 0x7f4f44147cd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.381+0000 7f528a800640 1 --2- 172.21.15.5:0/1380669033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c06ca30 0x7f528c06e0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f52780097a0 tx=0x7f527802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24334e0637c2482a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.381+0000 7f4f49a00640 1 --2- 172.21.15.5:0/3566940587 >> v2:172.21.15.112:3300/0 conn(0x7f4f4406e630 0x7f4f440b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.382+0000 7fb11fe00640 1 Processor -- start 2024-04-26T21:37:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.381+0000 7f150fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f15080097f0 0x7f15080ca820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50730/0 (socket says 172.21.15.5:50730) 2024-04-26T21:37:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.381+0000 7f150fe00640 1 -- 172.21.15.5:0/4241227945 learned_addr learned my addr 172.21.15.5:0/4241227945 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.381+0000 7f4f49a00640 1 -- 172.21.15.5:0/3566940587 >> 172.21.15.5:0/3566940587 conn(0x7f4f440b7d90 msgr2=0x7f4f440b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.382+0000 7f5289400640 1 -- 172.21.15.5:0/1380669033 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278037070 con 0x7f528c06ca30 2024-04-26T21:37:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.382+0000 7fb11fe00640 1 -- start start 2024-04-26T21:37:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.383+0000 7f5289400640 1 -- 172.21.15.5:0/1380669033 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5278032440 con 0x7f528c06ca30 2024-04-26T21:37:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.382+0000 7f4f49a00640 1 -- 172.21.15.5:0/3566940587 shutdown_connections 2024-04-26T21:37:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 -- 172.21.15.5:0/1380669033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c06ca30 msgr2=0x7f528c06e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 --2- 172.21.15.5:0/1380669033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c06ca30 0x7f528c06e0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f52780097a0 tx=0x7f527802a110 comp rx=0 tx=0).stop 2024-04-26T21:37:43.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 -- 172.21.15.5:0/1380669033 shutdown_connections 2024-04-26T21:37:43.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 --2- 172.21.15.5:0/1380669033 >> v2:172.21.15.5:3300/0 conn(0x7f528c0738a0 0x7f528c0b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7fb11fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1200b2a80 0x7fb1200737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 --2- 172.21.15.5:0/1380669033 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c06ca30 0x7f528c06e0d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 -- 172.21.15.5:0/1380669033 >> 172.21.15.5:0/1380669033 conn(0x7f528c0b7d90 msgr2=0x7f528c0b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 -- 172.21.15.5:0/1380669033 shutdown_connections 2024-04-26T21:37:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7f5291400640 1 -- 172.21.15.5:0/1380669033 wait complete. 2024-04-26T21:37:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7fb11fe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1200b3cf0 con 0x7fb1200b66c0 2024-04-26T21:37:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7fb11fe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1200b1240 con 0x7fb120144820 2024-04-26T21:37:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.384+0000 7fb11fe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb12013ed30 con 0x7fb1200b2a80 2024-04-26T21:37:43.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.385+0000 7fd458800640 1 Processor -- start 2024-04-26T21:37:43.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.385+0000 7fb11ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1200b66c0 0x7fb1200b6e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56160/0 (socket says 172.21.15.5:56160) 2024-04-26T21:37:43.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.385+0000 7fb11ea00640 1 -- 172.21.15.5:0/779758329 learned_addr learned my addr 172.21.15.5:0/779758329 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.385+0000 7fd458800640 1 -- start start 2024-04-26T21:37:43.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.383+0000 7f4f49a00640 1 -- 172.21.15.5:0/3566940587 wait complete. 2024-04-26T21:37:43.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.382+0000 7f1515600640 1 --2- 172.21.15.5:0/4241227945 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080caf30 0x7f15080dc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.385+0000 7fb11e000640 1 --2- 172.21.15.5:0/779758329 >> v2:172.21.15.5:3300/0 conn(0x7fb1200b2a80 0x7fb1200737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fd458800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c038ce0 0x7fd44c0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fd458800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd44c0caae0 0x7fd44c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fd458800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44c0390c0 con 0x7fd44c0c0a10 2024-04-26T21:37:43.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fd458800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd44c036db0 con 0x7fd44c0caae0 2024-04-26T21:37:43.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fd458800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c03a5c0 con 0x7fd44c038ce0 2024-04-26T21:37:43.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7f5291400640 1 Processor -- start 2024-04-26T21:37:43.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fb11e000640 1 -- 172.21.15.5:0/779758329 >> v1:172.21.15.112:6789/0 conn(0x7fb120144820 legacy=0x7fb120144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fb11e000640 1 -- 172.21.15.5:0/779758329 >> v1:172.21.15.5:6789/0 conn(0x7fb1200b66c0 legacy=0x7fb1200b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fb11e000640 1 -- 172.21.15.5:0/779758329 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1200b1520 con 0x7fb1200b2a80 2024-04-26T21:37:43.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7f5291400640 1 -- start start 2024-04-26T21:37:43.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.388+0000 7fd455e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c038ce0 0x7fd44c0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.387+0000 7fd455400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd44c0caae0 0x7fd44c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.388+0000 7fd456800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd44c0c0a10 0x7fd44c037970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50740/0 (socket says 172.21.15.5:50740) 2024-04-26T21:37:43.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.388+0000 7fd456800640 1 -- 172.21.15.5:0/1810217094 learned_addr learned my addr 172.21.15.5:0/1810217094 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.388+0000 7f4f49a00640 1 Processor -- start 2024-04-26T21:37:43.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.386+0000 7f1515600640 1 -- 172.21.15.5:0/4241227945 >> v1:172.21.15.112:6789/0 conn(0x7f15080097f0 legacy=0x7f15080ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.386+0000 7f1515600640 1 -- 172.21.15.5:0/4241227945 >> v1:172.21.15.5:6789/0 conn(0x7f1508008c90 legacy=0x7f15080d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.386+0000 7f150f400640 1 -- 172.21.15.5:0/4241227945 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482687624 0 0) 0x7f1508037040 con 0x7f1508008c90 2024-04-26T21:37:43.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.386+0000 7f1515600640 1 -- 172.21.15.5:0/4241227945 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15080d0bc0 con 0x7f15080caf30 2024-04-26T21:37:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7f4f49a00640 1 -- start start 2024-04-26T21:37:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7f5291400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528c06ca30 0x7f528c1480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7f5291400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c0738a0 0x7f528c1e2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7f5291400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f528c0b0a80 0x7f528c1e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7f5291400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f528c06e830 con 0x7f528c0b0a80 2024-04-26T21:37:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7f5291400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f528c06e6b0 con 0x7f528c06ca30 2024-04-26T21:37:43.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7f5291400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f528c1507f0 con 0x7f528c0738a0 2024-04-26T21:37:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.388+0000 7fd454a00640 1 -- 172.21.15.5:0/1810217094 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294366222 0 0) 0x7fd44c0390c0 con 0x7fd44c0c0a10 2024-04-26T21:37:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7fd454a00640 1 -- 172.21.15.5:0/1810217094 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd438003520 con 0x7fd44c0c0a10 2024-04-26T21:37:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7fb11e000640 1 --2- 172.21.15.5:0/779758329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb1200737e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0097a0 tx=0x7fb10c02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdcea5861cacf42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7fb11d600640 1 -- 172.21.15.5:0/779758329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c037070 con 0x7fb1200b2a80 2024-04-26T21:37:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7fb11d600640 1 -- 172.21.15.5:0/779758329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c02ad60 con 0x7fb1200b2a80 2024-04-26T21:37:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7fb11d600640 1 -- 172.21.15.5:0/779758329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c037070 con 0x7fb1200b2a80 2024-04-26T21:37:43.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7f528b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f528c0b0a80 0x7f528c1e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7f528b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f528c0b0a80 0x7f528c1e2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49368/0 (socket says 172.21.15.5:49368) 2024-04-26T21:37:43.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7f528b200640 1 -- 172.21.15.5:0/28903677 learned_addr learned my addr 172.21.15.5:0/28903677 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7fd455400640 1 -- 172.21.15.5:0/1810217094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c038ce0 msgr2=0x7fd44c0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7fd455400640 1 --2- 172.21.15.5:0/1810217094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c038ce0 0x7fd44c0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7fd455400640 1 -- 172.21.15.5:0/1810217094 >> v1:172.21.15.112:6789/0 conn(0x7fd44c0c0a10 legacy=0x7fd44c037970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.389+0000 7fd455400640 1 -- 172.21.15.5:0/1810217094 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c02bde0 con 0x7fd44c0caae0 2024-04-26T21:37:43.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7f528a800640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528c06ca30 0x7f528c1480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7f5289e00640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c0738a0 0x7f528c1e2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.390+0000 7f1515600640 1 --2- 172.21.15.5:0/4241227945 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080caf30 0x7f15080dc320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f15000097d0 tx=0x7f150002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b62540bdb97a3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f42fd200640 1 Processor -- start 2024-04-26T21:37:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f4f49a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4406e630 0x7f4f440b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7fd455400640 1 --2- 172.21.15.5:0/1810217094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0caae0 0x7fd44c0caf40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4400097a0 tx=0x7fd44002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eea4f47964e8d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f4f49a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f44073e30 0x7f4f44072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f4f49a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4413ffc0 0x7f4f44140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f4f49a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4f440afe40 con 0x7f4f4406e630 2024-04-26T21:37:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f528b200640 1 -- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c0738a0 msgr2=0x7f528c1e2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f528b200640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f528c0738a0 0x7f528c1e2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f528b200640 1 -- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528c06ca30 msgr2=0x7f528c1480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f528b200640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f528c06ca30 0x7f528c1480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f528b200640 1 -- 172.21.15.5:0/28903677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c149370 con 0x7f528c0b0a80 2024-04-26T21:37:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f42fd200640 1 -- start start 2024-04-26T21:37:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f4f49a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f440afb60 con 0x7f4f4413ffc0 2024-04-26T21:37:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7fd454a00640 1 -- 172.21.15.5:0/1810217094 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440037070 con 0x7fd44c0caae0 2024-04-26T21:37:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7fd454a00640 1 -- 172.21.15.5:0/1810217094 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44002adb0 con 0x7fd44c0caae0 2024-04-26T21:37:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7fd454a00640 1 -- 172.21.15.5:0/1810217094 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440032660 con 0x7fd44c0caae0 2024-04-26T21:37:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.391+0000 7f4f49a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4f440b0120 con 0x7f4f44073e30 2024-04-26T21:37:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f4f42a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4406e630 0x7f4f440b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f4f42a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4406e630 0x7f4f440b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49384/0 (socket says 172.21.15.5:49384) 2024-04-26T21:37:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f4f42a00640 1 -- 172.21.15.5:0/957419879 learned_addr learned my addr 172.21.15.5:0/957419879 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f528b200640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f528c0b0a80 0x7f528c1e2ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f528400c760 tx=0x7f528400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284016020 con 0x7f528c0b0a80 2024-04-26T21:37:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5284006d50 con 0x7f528c0b0a80 2024-04-26T21:37:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284016020 con 0x7f528c0b0a80 2024-04-26T21:37:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c1488b0 con 0x7f528c0b0a80 2024-04-26T21:37:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fd458800640 1 -- 172.21.15.5:0/1810217094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0caae0 msgr2=0x7fd44c0caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fd458800640 1 --2- 172.21.15.5:0/1810217094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0caae0 0x7fd44c0caf40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4400097a0 tx=0x7fd44002a060 comp rx=0 tx=0).stop 2024-04-26T21:37:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f42fd200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f42f80bea00 0x7f42f8148980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f42fd200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f814cb70 0x7f42f80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f150f400640 1 -- 172.21.15.5:0/4241227945 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500037070 con 0x7f15080caf30 2024-04-26T21:37:43.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f150f400640 1 -- 172.21.15.5:0/4241227945 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500032440 con 0x7f15080caf30 2024-04-26T21:37:43.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f150f400640 1 -- 172.21.15.5:0/4241227945 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500032810 con 0x7f15080caf30 2024-04-26T21:37:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7fb11fe00640 1 -- 172.21.15.5:0/779758329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 msgr2=0x7fb1200737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7fb11fe00640 1 --2- 172.21.15.5:0/779758329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb1200737e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0097a0 tx=0x7fb10c02a0d0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fd458800640 1 -- 172.21.15.5:0/1810217094 shutdown_connections 2024-04-26T21:37:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7f42fd200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f80bede0 con 0x7f42f80b7b00 2024-04-26T21:37:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7f42fd200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f42f8143150 con 0x7f42f80bea00 2024-04-26T21:37:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7f42fd200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42f80b8050 con 0x7f42f814cb70 2024-04-26T21:37:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fd458800640 1 --2- 172.21.15.5:0/1810217094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c0caae0 0x7fd44c0caf40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fd458800640 1 --2- 172.21.15.5:0/1810217094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c038ce0 0x7fd44c0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fd458800640 1 -- 172.21.15.5:0/1810217094 >> 172.21.15.5:0/1810217094 conn(0x7fd44c03cae0 msgr2=0x7fd44c03cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fb11fe00640 1 -- 172.21.15.5:0/779758329 shutdown_connections 2024-04-26T21:37:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fb11fe00640 1 --2- 172.21.15.5:0/779758329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb1200737e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fb11fe00640 1 -- 172.21.15.5:0/779758329 >> 172.21.15.5:0/779758329 conn(0x7fb12006c4e0 msgr2=0x7fb12006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f4f43400640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4413ffc0 0x7f4f44140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7fd458800640 1 -- 172.21.15.5:0/1810217094 shutdown_connections 2024-04-26T21:37:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7f1517600640 1 -- 172.21.15.5:0/4241227945 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080caf30 msgr2=0x7f15080dc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.393+0000 7f1517600640 1 --2- 172.21.15.5:0/4241227945 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080caf30 0x7f15080dc320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f15000097d0 tx=0x7f150002a230 comp rx=0 tx=0).stop 2024-04-26T21:37:43.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7f42f6800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f42f80b7b00 0x7f42f80b8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50754/0 (socket says 172.21.15.5:50754) 2024-04-26T21:37:43.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7f42f6800640 1 -- 172.21.15.5:0/4052978082 learned_addr learned my addr 172.21.15.5:0/4052978082 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7f42f5e00640 1 --2- 172.21.15.5:0/4052978082 >> v2:172.21.15.112:3300/0 conn(0x7f42f80bea00 0x7f42f8148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.392+0000 7f4f42000640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f44073e30 0x7f4f44072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c070c20 con 0x7f528c0b0a80 2024-04-26T21:37:43.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7fd458800640 1 -- 172.21.15.5:0/1810217094 wait complete. 2024-04-26T21:37:43.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f4f43400640 1 -- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f44073e30 msgr2=0x7f4f44072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f4f43400640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f44073e30 0x7f4f44072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f4f43400640 1 -- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4406e630 msgr2=0x7f4f440b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f4f43400640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4406e630 0x7f4f440b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f4f43400640 1 -- 172.21.15.5:0/957419879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4409fbc0 con 0x7f4f4413ffc0 2024-04-26T21:37:43.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f4f42a00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4406e630 0x7f4f440b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:43.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f4f43400640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4413ffc0 0x7f4f44140450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00ba80 tx=0x7f4f3c00bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00c780 con 0x7f4f4413ffc0 2024-04-26T21:37:43.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f44143210 con 0x7f4f4413ffc0 2024-04-26T21:37:43.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f42f5400640 1 --2- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f814cb70 0x7f42f80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f42f4a00640 1 -- 172.21.15.5:0/4052978082 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769217310 0 0) 0x7f42f80bede0 con 0x7f42f80b7b00 2024-04-26T21:37:43.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f42f5e00640 1 -- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f814cb70 msgr2=0x7f42f80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f42f5e00640 1 --2- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f814cb70 0x7f42f80b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f42f5e00640 1 -- 172.21.15.5:0/4052978082 >> v1:172.21.15.112:6789/0 conn(0x7f42f80b7b00 legacy=0x7f42f80b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f42f5e00640 1 -- 172.21.15.5:0/4052978082 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f814c090 con 0x7f42f80bea00 2024-04-26T21:37:43.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7f1517600640 1 -- 172.21.15.5:0/4241227945 shutdown_connections 2024-04-26T21:37:43.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7f1517600640 1 --2- 172.21.15.5:0/4241227945 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080caf30 0x7f15080dc320 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7f1517600640 1 -- 172.21.15.5:0/4241227945 >> 172.21.15.5:0/4241227945 conn(0x7f150803cae0 msgr2=0x7f150803cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f1517600640 1 -- 172.21.15.5:0/4241227945 shutdown_connections 2024-04-26T21:37:43.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.394+0000 7fb11fe00640 1 -- 172.21.15.5:0/779758329 shutdown_connections 2024-04-26T21:37:43.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f440717d0 con 0x7f4f4413ffc0 2024-04-26T21:37:43.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.395+0000 7fb11fe00640 1 -- 172.21.15.5:0/779758329 wait complete. 2024-04-26T21:37:43.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.397+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c00c920 con 0x7f4f4413ffc0 2024-04-26T21:37:43.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.397+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00c780 con 0x7f4f4413ffc0 2024-04-26T21:37:43.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7fd458800640 1 Processor -- start 2024-04-26T21:37:43.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.396+0000 7fd458800640 1 -- start start 2024-04-26T21:37:43.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.397+0000 7fb11fe00640 1 Processor -- start 2024-04-26T21:37:43.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.398+0000 7fd458800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c038ce0 0x7fd44c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.398+0000 7fd458800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c0c0a10 0x7fd44c007ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.397+0000 7fb11fe00640 1 -- start start 2024-04-26T21:37:43.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.398+0000 7fd458800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0caae0 0x7fd44c0083e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f528c06d9f0 con 0x7f528c0b0a80 2024-04-26T21:37:43.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7fd456800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0caae0 0x7fd44c0083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7fd456800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0caae0 0x7fd44c0083e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49392/0 (socket says 172.21.15.5:49392) 2024-04-26T21:37:43.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7fd455e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c038ce0 0x7fd44c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7fd455400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c0c0a10 0x7fd44c007ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7fd456800640 1 -- 172.21.15.5:0/45515535 learned_addr learned my addr 172.21.15.5:0/45515535 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7fb11fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb12013c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5284003970 con 0x7f528c0b0a80 2024-04-26T21:37:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.399+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c0ce390 con 0x7fd44c0caae0 2024-04-26T21:37:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.400+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c0ca5c0 con 0x7fd44c038ce0 2024-04-26T21:37:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.400+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c039ce0 con 0x7fd44c0c0a10 2024-04-26T21:37:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.398+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f1c001030 con 0x7f4f4413ffc0 2024-04-26T21:37:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.398+0000 7f1517600640 1 -- 172.21.15.5:0/4241227945 wait complete. 2024-04-26T21:37:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.400+0000 7fb11fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1200b66c0 0x7fb1201e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.400+0000 7fb11fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb120144820 0x7fb1201e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.400+0000 7f1517600640 1 Processor -- start 2024-04-26T21:37:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fd456800640 1 -- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c0c0a10 msgr2=0x7fd44c007ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fd456800640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd44c0c0a10 0x7fd44c007ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fd456800640 1 -- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c038ce0 msgr2=0x7fd44c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fd456800640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd44c038ce0 0x7fd44c0ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fd456800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c0c18c0 con 0x7fd44c0caae0 2024-04-26T21:37:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7f1517600640 1 -- start start 2024-04-26T21:37:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fb11fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb120073ea0 con 0x7fb1200b2a80 2024-04-26T21:37:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fb11fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb120073d20 con 0x7fb120144820 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fb11fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb1200b62b0 con 0x7fb1200b66c0 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb12013c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fb11ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb12013c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49400/0 (socket says 172.21.15.5:49400) 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fb11ea00640 1 -- 172.21.15.5:0/3426173875 learned_addr learned my addr 172.21.15.5:0/3426173875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.401+0000 7fd456800640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0caae0 0x7fd44c0083e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd450077620 tx=0x7fd450069eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fb11ea00640 1 -- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1200b66c0 msgr2=0x7fb1201e2c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fb11ea00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1200b66c0 0x7fb1201e2c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fb11ea00640 1 -- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb120144820 msgr2=0x7fb1201e3140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:37:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fb11ea00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb120144820 0x7fb1201e3140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fb11ea00640 1 -- 172.21.15.5:0/3426173875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12013f5e0 con 0x7fb1200b2a80 2024-04-26T21:37:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7f1517600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1508008c90 0x7f150815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7f5282a00640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f526c06cb20 0x7f526c06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f528408b5d0 con 0x7f528c0b0a80 2024-04-26T21:37:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7f5282a00640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f526c076210 0x7f526c078650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 --> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f528401eec0 con 0x7f526c076210 2024-04-26T21:37:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5284092050 con 0x7f528c0b0a80 2024-04-26T21:37:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450075720 con 0x7fd44c0caae0 2024-04-26T21:37:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4500758c0 con 0x7fd44c0caae0 2024-04-26T21:37:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c0cd590 con 0x7fd44c0caae0 2024-04-26T21:37:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.402+0000 7f1517600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1508156dd0 0x7f1508157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.403+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c0cb570 con 0x7fd44c0caae0 2024-04-26T21:37:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.403+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450075cf0 con 0x7fd44c0caae0 2024-04-26T21:37:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.403+0000 7f1517600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080c7880 0x7f15080c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.403+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f3c00cad0 con 0x7f4f4413ffc0 2024-04-26T21:37:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.403+0000 7f42f5e00640 1 --2- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f80bea00 0x7f42f8148980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d878ef027546ccc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.404+0000 7fb11ea00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb12013c0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c750 tx=0x7fb11000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.404+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd42c001030 con 0x7fd44c0caae0 2024-04-26T21:37:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.404+0000 7f528a800640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f526c06cb20 0x7f526c06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.404+0000 7f5289e00640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f526c076210 0x7f526c078650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.404+0000 7f1514c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1508008c90 0x7f150815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.404+0000 7f1514c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1508008c90 0x7f150815a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:53982/0 (socket says 172.21.15.5:53982) 2024-04-26T21:37:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f1515600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080c7880 0x7f15080c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110017070 con 0x7fb1200b2a80 2024-04-26T21:37:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f150fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1508156dd0 0x7f1508157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f150fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1508156dd0 0x7f1508157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49408/0 (socket says 172.21.15.5:49408) 2024-04-26T21:37:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f1517600640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f150803a5c0 con 0x7f1508156dd0 2024-04-26T21:37:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f1514c00640 1 -- 172.21.15.5:0/3329080332 learned_addr learned my addr 172.21.15.5:0/3329080332 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f1517600640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1508038190 con 0x7f1508008c90 2024-04-26T21:37:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f1517600640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f150803a740 con 0x7f15080c7880 2024-04-26T21:37:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f1515600640 1 -- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1508008c90 msgr2=0x7f150815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12013f860 con 0x7fb1200b2a80 2024-04-26T21:37:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb120141cb0 con 0x7fb1200b2a80 2024-04-26T21:37:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb110005ae0 con 0x7fb1200b2a80 2024-04-26T21:37:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f4f3aa00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4f2406caf0 0x7f4f2406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.405+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4f3c08b520 con 0x7f4f4413ffc0 2024-04-26T21:37:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f4f3aa00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7f4f24076270 0x7f4f240786b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 --> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f3c012ec0 con 0x7f4f24076270 2024-04-26T21:37:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4f3c08b910 con 0x7f4f4413ffc0 2024-04-26T21:37:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110007070 con 0x7fb1200b2a80 2024-04-26T21:37:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f1515600640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1508008c90 0x7f150815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f1515600640 1 -- 172.21.15.5:0/3329080332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1508156dd0 msgr2=0x7f1508157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f1515600640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1508156dd0 0x7f1508157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f1515600640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1508158260 con 0x7f15080c7880 2024-04-26T21:37:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f1514c00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1508008c90 0x7f150815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f150fe00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1508156dd0 0x7f1508157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.407+0000 7f1515600640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080c7880 0x7f15080c7d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1508037210 tx=0x7f15000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.407+0000 7f4f42000640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7f4f24076270 0x7f4f240786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.407+0000 7f4f42a00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4f2406caf0 0x7f4f2406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.406+0000 7f5289e00640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f526c076210 0x7f526c078650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.408+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== osd.1 v2:172.21.15.5:6801/29367179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f528401eec0 con 0x7f526c076210 2024-04-26T21:37:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.407+0000 7f42f4a00640 1 -- 172.21.15.5:0/4052978082 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8037070 con 0x7f42f80bea00 2024-04-26T21:37:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.407+0000 7f42f4a00640 1 -- 172.21.15.5:0/4052978082 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e802ae40 con 0x7f42f80bea00 2024-04-26T21:37:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.407+0000 7f42f4a00640 1 -- 172.21.15.5:0/4052978082 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8032660 con 0x7f42f80bea00 2024-04-26T21:37:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.408+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500042020 con 0x7f15080c7880 2024-04-26T21:37:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.408+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd450074040 con 0x7fd44c0caae0 2024-04-26T21:37:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.408+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15000308f0 con 0x7f15080c7880 2024-04-26T21:37:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.408+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500037040 con 0x7f15080c7880 2024-04-26T21:37:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.408+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0f8001030 con 0x7fb1200b2a80 2024-04-26T21:37:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.409+0000 7f4f42000640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7f4f24076270 0x7f4f240786b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.410+0000 7fd44a000640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd43406c9f0 0x7fd43406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.409+0000 7f1517600640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1508157790 con 0x7f15080c7880 2024-04-26T21:37:43.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.409+0000 7f1517600640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1508159bd0 con 0x7f15080c7880 2024-04-26T21:37:43.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.410+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd450108be0 con 0x7fd44c0caae0 2024-04-26T21:37:43.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.410+0000 7fd44a000640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7fd434076170 0x7fd4340785b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.410+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd434078c80 con 0x7fd434076170 2024-04-26T21:37:43.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.410+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd450108fd0 con 0x7fd44c0caae0 2024-04-26T21:37:43.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.410+0000 7f4f42a00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4f2406caf0 0x7f4f2406efb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006fd0 tx=0x7f4f30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.409+0000 7f42fd200640 1 -- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f80bea00 msgr2=0x7f42f8148980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.409+0000 7f42fd200640 1 --2- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f80bea00 0x7f42f8148980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a0f0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.411+0000 7fd455400640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7fd434076170 0x7fd4340785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.411+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== osd.0 v2:172.21.15.5:6800/2132096310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f3c012ec0 con 0x7f4f24076270 2024-04-26T21:37:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.411+0000 7fd455e00640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd43406c9f0 0x7fd43406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.411+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14e8001030 con 0x7f15080c7880 2024-04-26T21:37:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.412+0000 7fd455400640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7fd434076170 0x7fd4340785b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.413+0000 7fd455e00640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd43406c9f0 0x7fd43406eeb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd444009b40 tx=0x7fd444009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.414+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1500045020 con 0x7f15080c7880 2024-04-26T21:37:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.413+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb11001a070 con 0x7fb1200b2a80 2024-04-26T21:37:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7fb116a00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb10006c940 0x7fb10006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb11008b0f0 con 0x7fb1200b2a80 2024-04-26T21:37:43.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7f42fd200640 1 -- 172.21.15.5:0/4052978082 shutdown_connections 2024-04-26T21:37:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7f42fd200640 1 --2- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f814cb70 0x7f42f80b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7f42fd200640 1 --2- 172.21.15.5:0/4052978082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f80bea00 0x7f42f8148980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7f42fd200640 1 -- 172.21.15.5:0/4052978082 >> 172.21.15.5:0/4052978082 conn(0x7f42f8068720 msgr2=0x7f42f80be080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.416+0000 7f42fd200640 1 -- 172.21.15.5:0/4052978082 shutdown_connections 2024-04-26T21:37:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.416+0000 7f42fd200640 1 -- 172.21.15.5:0/4052978082 wait complete. 2024-04-26T21:37:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.416+0000 7f150cc00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14f406c970 0x7f14f406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.416+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== osd.2 v2:172.21.15.5:6816/1477821475 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd434078c80 con 0x7fd434076170 2024-04-26T21:37:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7fb116a00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7fb100076030 0x7fb100078470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.415+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 --> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb110005ae0 con 0x7fb100076030 2024-04-26T21:37:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.417+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f15000ac7d0 con 0x7f15080c7880 2024-04-26T21:37:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.417+0000 7fb11e000640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb10006c940 0x7fb10006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.417+0000 7f1514c00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14f406c970 0x7f14f406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.417+0000 7f150cc00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7f14f40760f0 0x7f14f4078530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.417+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14f4078c00 con 0x7f14f40760f0 2024-04-26T21:37:43.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.417+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f15000acb80 con 0x7f15080c7880 2024-04-26T21:37:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.417+0000 7f528a800640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f526c06cb20 0x7f526c06efe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5278034000 tx=0x7f527802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.418+0000 7f150fe00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7f14f40760f0 0x7f14f4078530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.418+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb110092050 con 0x7fb1200b2a80 2024-04-26T21:37:43.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.418+0000 7fb11e000640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb10006c940 0x7fb10006ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb10c034000 tx=0x7fb10c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.419+0000 7f1514c00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14f406c970 0x7f14f406ee30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f151007ba00 tx=0x7f1510070040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.418+0000 7fb11f400640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7fb100076030 0x7fb100078470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.420+0000 7fb11f400640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7fb100076030 0x7fb100078470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.420+0000 7f42fd200640 1 Processor -- start 2024-04-26T21:37:43.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.420+0000 7f150fe00640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7f14f40760f0 0x7f14f4078530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.420+0000 7f42fd200640 1 -- start start 2024-04-26T21:37:43.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.421+0000 7f42fd200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f80b7b00 0x7f42f81ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.421+0000 7f42fd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80bea00 0x7f42f80aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.421+0000 7f42fd200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f814cb70 0x7f42f80aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.421+0000 7f42fd200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8148ec0 con 0x7f42f80bea00 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.421+0000 7f42fd200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42f814c650 con 0x7f42f814cb70 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.421+0000 7f42fd200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42f80b55a0 con 0x7f42f80b7b00 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.422+0000 7f42f5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f80b7b00 0x7f42f81ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.422+0000 7f42f5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80bea00 0x7f42f80aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.422+0000 7f42f5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f80b7b00 0x7f42f81ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:48974/0 (socket says 172.21.15.5:48974) 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.422+0000 7f42f5e00640 1 -- 172.21.15.5:0/2501685235 learned_addr learned my addr 172.21.15.5:0/2501685235 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.422+0000 7f42f6800640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f814cb70 0x7f42f80aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.423+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== osd.7 v2:172.21.15.112:6816/403622825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb110005ae0 con 0x7fb100076030 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.423+0000 7f42f5400640 1 -- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f80b7b00 msgr2=0x7f42f81ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.423+0000 7f42f5400640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42f80b7b00 0x7f42f81ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.423+0000 7f42f5400640 1 -- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f814cb70 msgr2=0x7f42f80aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.423+0000 7f42f5400640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42f814cb70 0x7f42f80aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.423+0000 7f42f5400640 1 -- 172.21.15.5:0/2501685235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f80acb40 con 0x7f42f80bea00 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.424+0000 7f42f5400640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80bea00 0x7f42f80aa8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f42e400d550 tx=0x7f42e400da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.425+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e40125f0 con 0x7f42f80bea00 2024-04-26T21:37:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.425+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e4019070 con 0x7f42f80bea00 2024-04-26T21:37:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.425+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e40129b0 con 0x7f42f80bea00 2024-04-26T21:37:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.425+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f80ad090 con 0x7f42f80bea00 2024-04-26T21:37:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.425+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f80acdb0 con 0x7f42f80bea00 2024-04-26T21:37:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.424+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== osd.5 v2:172.21.15.112:6808/2214364032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14f4078c00 con 0x7f14f40760f0 2024-04-26T21:37:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.429+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42f8075db0 con 0x7f42f80bea00 2024-04-26T21:37:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.430+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42e4012b50 con 0x7f42f80bea00 2024-04-26T21:37:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.431+0000 7f930f800640 1 Processor -- start 2024-04-26T21:37:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.431+0000 7f42ee000640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42d806c970 0x7f42d806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.432+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f42e408bfe0 con 0x7f42f80bea00 2024-04-26T21:37:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.432+0000 7f42ee000640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f42d80760e0 0x7f42d8078520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.432+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 --> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42e4001d30 con 0x7f42d80760e0 2024-04-26T21:37:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.432+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42e4093050 con 0x7f42f80bea00 2024-04-26T21:37:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.432+0000 7f42f5e00640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42d806c970 0x7f42d806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f42f6800640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f42d80760e0 0x7f42d8078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.431+0000 7f930f800640 1 -- start start 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f930f800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93080bea00 0x7f9308148980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f930f800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93080b7b00 0x7f9308153220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f930f800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080bede0 con 0x7f930814cb70 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f930f800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9308143150 con 0x7f93080bea00 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f930f800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f93080b8050 con 0x7f93080b7b00 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f9307e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f930814cb70 0x7f93080b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50770/0 (socket says 172.21.15.5:50770) 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.433+0000 7f9307e00640 1 -- 172.21.15.5:0/1248719026 learned_addr learned my addr 172.21.15.5:0/1248719026 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.434+0000 7f930d800640 1 --2- 172.21.15.5:0/1248719026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93080b7b00 0x7f9308153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.435+0000 7f9307400640 1 -- 172.21.15.5:0/1248719026 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537563065 0 0) 0x7f93080bede0 con 0x7f930814cb70 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.435+0000 7f9307400640 1 -- 172.21.15.5:0/1248719026 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f0003520 con 0x7f930814cb70 2024-04-26T21:37:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.435+0000 7f930ce00640 1 --2- 172.21.15.5:0/1248719026 >> v2:172.21.15.5:3300/0 conn(0x7f93080bea00 0x7f9308148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.435+0000 7f42f6800640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f42d80760e0 0x7f42d8078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.436+0000 7f930d800640 1 -- 172.21.15.5:0/1248719026 >> v2:172.21.15.5:3300/0 conn(0x7f93080bea00 msgr2=0x7f9308148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.436+0000 7f42f5e00640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42d806c970 0x7f42d806ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009560 tx=0x7f42e802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.436+0000 7f930d800640 1 --2- 172.21.15.5:0/1248719026 >> v2:172.21.15.5:3300/0 conn(0x7f93080bea00 0x7f9308148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.436+0000 7f930d800640 1 -- 172.21.15.5:0/1248719026 >> v1:172.21.15.112:6789/0 conn(0x7f930814cb70 legacy=0x7f93080b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.436+0000 7f930d800640 1 -- 172.21.15.5:0/1248719026 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930814c090 con 0x7f93080b7b00 2024-04-26T21:37:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.437+0000 7f930ce00640 1 --2- 172.21.15.5:0/1248719026 >> v2:172.21.15.5:3300/0 conn(0x7f93080bea00 0x7f9308148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.438+0000 7f930d800640 1 --2- 172.21.15.5:0/1248719026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93080b7b00 0x7f9308153220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae939391fb66829 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.438+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== osd.4 v2:172.21.15.112:6824/2443506001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42e4001d30 con 0x7f42d80760e0 2024-04-26T21:37:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.443+0000 7f9307400640 1 -- 172.21.15.5:0/1248719026 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300007740 con 0x7f93080b7b00 2024-04-26T21:37:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.443+0000 7f9307400640 1 -- 172.21.15.5:0/1248719026 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93000078e0 con 0x7f93080b7b00 2024-04-26T21:37:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.443+0000 7f9307400640 1 -- 172.21.15.5:0/1248719026 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300007cd0 con 0x7f93080b7b00 2024-04-26T21:37:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.444+0000 7f930f800640 1 -- 172.21.15.5:0/1248719026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93080b7b00 msgr2=0x7f9308153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.444+0000 7f930f800640 1 --2- 172.21.15.5:0/1248719026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93080b7b00 0x7f9308153220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930002a5f0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.444+0000 7f930f800640 1 -- 172.21.15.5:0/1248719026 shutdown_connections 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.444+0000 7f930f800640 1 --2- 172.21.15.5:0/1248719026 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f93080b7b00 0x7f9308153220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.444+0000 7f930f800640 1 --2- 172.21.15.5:0/1248719026 >> v2:172.21.15.5:3300/0 conn(0x7f93080bea00 0x7f9308148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.444+0000 7f930f800640 1 -- 172.21.15.5:0/1248719026 >> 172.21.15.5:0/1248719026 conn(0x7f9308068720 msgr2=0x7f93080be080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.447+0000 7f930f800640 1 -- 172.21.15.5:0/1248719026 shutdown_connections 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.447+0000 7f930f800640 1 -- 172.21.15.5:0/1248719026 wait complete. 2024-04-26T21:37:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.450+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 --> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f528c075db0 con 0x7f526c076210 2024-04-26T21:37:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.450+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 --> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd42c002dd0 con 0x7fd434076170 2024-04-26T21:37:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.450+0000 7f5282a00640 1 -- 172.21.15.5:0/28903677 <== osd.1 v2:172.21.15.5:6801/29367179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f528c075db0 con 0x7f526c076210 2024-04-26T21:37:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.451+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 --> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f1c002dd0 con 0x7f4f24076270 2024-04-26T21:37:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.451+0000 7fd44a000640 1 -- 172.21.15.5:0/45515535 <== osd.2 v2:172.21.15.5:6816/1477821475 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd42c002dd0 con 0x7fd434076170 2024-04-26T21:37:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.451+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f526c076210 msgr2=0x7f526c078650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.452+0000 7f4f3aa00640 1 -- 172.21.15.5:0/957419879 <== osd.0 v2:172.21.15.5:6800/2132096310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4f1c002dd0 con 0x7f4f24076270 2024-04-26T21:37:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.452+0000 7f5291400640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f526c076210 0x7f526c078650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.452+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7fd434076170 msgr2=0x7fd4340785b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.452+0000 7fd458800640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7fd434076170 0x7fd4340785b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f526c06cb20 msgr2=0x7f526c06efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd43406c9f0 msgr2=0x7fd43406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7fd458800640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fd43406c9f0 0x7fd43406eeb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd444009b40 tx=0x7fd444009190 comp rx=0 tx=0).stop 2024-04-26T21:37:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0caae0 msgr2=0x7fd44c0083e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7fd458800640 1 --2- 172.21.15.5:0/45515535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd44c0caae0 0x7fd44c0083e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd450077620 tx=0x7fd450069eb0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7fd456800640 1 -- 172.21.15.5:0/45515535 reap_dead start 2024-04-26T21:37:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.452+0000 7f930f800640 1 Processor -- start 2024-04-26T21:37:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.452+0000 7f930f800640 1 -- start start 2024-04-26T21:37:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7f5291400640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f526c06cb20 0x7f526c06efe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5278034000 tx=0x7f527802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7f4f24076270 msgr2=0x7f4f240786b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7f4f49a00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7f4f24076270 0x7f4f240786b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f528c0b0a80 msgr2=0x7f528c1e2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7f5291400640 1 --2- 172.21.15.5:0/28903677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f528c0b0a80 0x7f528c1e2ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f528400c760 tx=0x7f528400cb60 comp rx=0 tx=0).stop 2024-04-26T21:37:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.453+0000 7f528b200640 1 -- 172.21.15.5:0/28903677 reap_dead start 2024-04-26T21:37:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 shutdown_connections 2024-04-26T21:37:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f930f800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b7b00 0x7f93081dbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f930f800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93080bea00 0x7f93081dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f930f800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f930814cb70 0x7f93081e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f930f800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9308148ec0 con 0x7f93080b7b00 2024-04-26T21:37:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f930f800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f930814c650 con 0x7f93080bea00 2024-04-26T21:37:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f930f800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f93080b44b0 con 0x7f930814cb70 2024-04-26T21:37:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 >> 172.21.15.5:0/45515535 conn(0x7fd44c03cae0 msgr2=0x7fd44c037d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4f2406caf0 msgr2=0x7f4f2406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f4f49a00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4f2406caf0 0x7f4f2406efb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006fd0 tx=0x7f4f30008040 comp rx=0 tx=0).stop 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4413ffc0 msgr2=0x7f4f44140450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f4f49a00640 1 --2- 172.21.15.5:0/957419879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f4413ffc0 0x7f4f44140450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00ba80 tx=0x7f4f3c00bf40 comp rx=0 tx=0).stop 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f4f43400640 1 -- 172.21.15.5:0/957419879 reap_dead start 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 shutdown_connections 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.454+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 >> 172.21.15.5:0/957419879 conn(0x7f4f440b7d90 msgr2=0x7f4f440b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 shutdown_connections 2024-04-26T21:37:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 >> 172.21.15.5:0/28903677 conn(0x7f528c0b7d90 msgr2=0x7f528c0af300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f9307e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93080bea00 0x7f93081dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b7b00 0x7f93081dbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b7b00 0x7f93081dbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49436/0 (socket says 172.21.15.5:49436) 2024-04-26T21:37:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 shutdown_connections 2024-04-26T21:37:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f5291400640 1 -- 172.21.15.5:0/28903677 wait complete. 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930ce00640 1 -- 172.21.15.5:0/2515455357 learned_addr learned my addr 172.21.15.5:0/2515455357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f9307e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93080bea00 0x7f93081dc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54002/0 (socket says 172.21.15.5:54002) 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930d800640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f930814cb70 0x7f93081e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930ce00640 1 -- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f930814cb70 msgr2=0x7f93081e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930ce00640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f930814cb70 0x7f93081e2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930ce00640 1 -- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93080bea00 msgr2=0x7f93081dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.455+0000 7f930ce00640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93080bea00 0x7f93081dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.456+0000 7f930ce00640 1 -- 172.21.15.5:0/2515455357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081e5ef0 con 0x7f93080b7b00 2024-04-26T21:37:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.456+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 shutdown_connections 2024-04-26T21:37:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.456+0000 7f4f49a00640 1 -- 172.21.15.5:0/957419879 wait complete. 2024-04-26T21:37:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.456+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 shutdown_connections 2024-04-26T21:37:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.456+0000 7f930ce00640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b7b00 0x7f93081dbe90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e810 tx=0x7f92fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.456+0000 7fd458800640 1 -- 172.21.15.5:0/45515535 wait complete. 2024-04-26T21:37:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.457+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00f040 con 0x7f93080b7b00 2024-04-26T21:37:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.457+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92fc004030 con 0x7f93080b7b00 2024-04-26T21:37:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.457+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc004400 con 0x7f93080b7b00 2024-04-26T21:37:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.457+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93081e61d0 con 0x7f93080b7b00 2024-04-26T21:37:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.458+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93080b3880 con 0x7f93080b7b00 2024-04-26T21:37:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.459+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f930813cc70 con 0x7f93080b7b00 2024-04-26T21:37:43.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.459+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 --> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14e8002dd0 con 0x7f14f40760f0 2024-04-26T21:37:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.461+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92fc00c6d0 con 0x7f93080b7b00 2024-04-26T21:37:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.462+0000 7f9304c00640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f92e806c8f0 0x7f92e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.463+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 --> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb0f8002dd0 con 0x7fb100076030 2024-04-26T21:37:43.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.463+0000 7f150cc00640 1 -- 172.21.15.5:0/3329080332 <== osd.5 v2:172.21.15.112:6808/2214364032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f14e8002dd0 con 0x7f14f40760f0 2024-04-26T21:37:43.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.463+0000 7f9307e00640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f92e806c8f0 0x7f92e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.464+0000 7fb116a00640 1 -- 172.21.15.5:0/3426173875 <== osd.7 v2:172.21.15.112:6816/403622825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb0f8002dd0 con 0x7fb100076030 2024-04-26T21:37:43.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f92fc0892d0 con 0x7f93080b7b00 2024-04-26T21:37:43.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.464+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7f14f40760f0 msgr2=0x7f14f4078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.464+0000 7f14fe000640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7f14f40760f0 0x7f14f4078530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14f406c970 msgr2=0x7f14f406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f14fe000640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14f406c970 0x7f14f406ee30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f151007ba00 tx=0x7f1510070040 comp rx=0 tx=0).stop 2024-04-26T21:37:43.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080c7880 msgr2=0x7f15080c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f14fe000640 1 --2- 172.21.15.5:0/3329080332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15080c7880 0x7f15080c7d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1508037210 tx=0x7f15000046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f1515600640 1 -- 172.21.15.5:0/3329080332 reap_dead start 2024-04-26T21:37:43.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 shutdown_connections 2024-04-26T21:37:43.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 >> 172.21.15.5:0/3329080332 conn(0x7f150803cae0 msgr2=0x7f1508004cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.466+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 shutdown_connections 2024-04-26T21:37:43.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.466+0000 7fadd3c00640 1 Processor -- start 2024-04-26T21:37:43.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.466+0000 7fadd3c00640 1 -- start start 2024-04-26T21:37:43.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.467+0000 7f14fe000640 1 -- 172.21.15.5:0/3329080332 wait complete. 2024-04-26T21:37:43.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.467+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7fb100076030 msgr2=0x7fb100078470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.467+0000 7fb11fe00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7fb100076030 0x7fb100078470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb10006c940 msgr2=0x7fb10006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb10006c940 0x7fb10006ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb10c034000 tx=0x7fb10c02e000 comp rx=0 tx=0).stop 2024-04-26T21:37:43.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 msgr2=0x7fb12013c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 --2- 172.21.15.5:0/3426173875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1200b2a80 0x7fb12013c0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c750 tx=0x7fb11000cc10 comp rx=0 tx=0).stop 2024-04-26T21:37:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11f400640 1 -- 172.21.15.5:0/3426173875 reap_dead start 2024-04-26T21:37:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 shutdown_connections 2024-04-26T21:37:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 >> 172.21.15.5:0/3426173875 conn(0x7fb12006c4e0 msgr2=0x7fb120144c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 shutdown_connections 2024-04-26T21:37:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.468+0000 7fb11fe00640 1 -- 172.21.15.5:0/3426173875 wait complete. 2024-04-26T21:37:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.465+0000 7f9304c00640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7f92e8075fe0 0x7f92e8078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.469+0000 7fadd3c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b5480 0x7fadcc0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.469+0000 7fadd3c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadcc1507f0 0x7fadcc150c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.469+0000 7fadd3c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc0b69c0 con 0x7fadcc0bea00 2024-04-26T21:37:43.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.469+0000 7fadd3c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fadcc0bede0 con 0x7fadcc1507f0 2024-04-26T21:37:43.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.469+0000 7fadd3c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc0b5910 con 0x7fadcc0b5480 2024-04-26T21:37:43.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.469+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 --> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92e8078af0 con 0x7f92e8075fe0 2024-04-26T21:37:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.470+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f92fc090060 con 0x7f93080b7b00 2024-04-26T21:37:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.470+0000 7f930d800640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7f92e8075fe0 0x7f92e8078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.471+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b5480 0x7fadcc0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.471+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b5480 0x7fadcc0b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49006/0 (socket says 172.21.15.5:49006) 2024-04-26T21:37:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.471+0000 7fadcbe00640 1 -- 172.21.15.5:0/4186750341 learned_addr learned my addr 172.21.15.5:0/4186750341 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.472+0000 7f930d800640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7f92e8075fe0 0x7f92e8078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.473+0000 7fadcbe00640 1 -- 172.21.15.5:0/4186750341 >> v2:172.21.15.5:3300/0 conn(0x7fadcc1507f0 msgr2=0x7fadcc150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.473+0000 7fadcbe00640 1 --2- 172.21.15.5:0/4186750341 >> v2:172.21.15.5:3300/0 conn(0x7fadcc1507f0 0x7fadcc150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.473+0000 7fadcbe00640 1 -- 172.21.15.5:0/4186750341 >> v1:172.21.15.5:6789/0 conn(0x7fadcc0bea00 legacy=0x7fadcc0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.473+0000 7fadcbe00640 1 -- 172.21.15.5:0/4186750341 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0b6be0 con 0x7fadcc0b5480 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.475+0000 7fadcbe00640 1 --2- 172.21.15.5:0/4186750341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b5480 0x7fadcc0b4b50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009870 tx=0x7fadb802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e52c5659ef04c13a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.476+0000 7fadcb400640 1 -- 172.21.15.5:0/4186750341 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8037070 con 0x7fadcc0b5480 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.476+0000 7fadcb400640 1 -- 172.21.15.5:0/4186750341 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb802adf0 con 0x7fadcc0b5480 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.476+0000 7fadcb400640 1 -- 172.21.15.5:0/4186750341 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8032660 con 0x7fadcc0b5480 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.477+0000 7fadd3c00640 1 -- 172.21.15.5:0/4186750341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b5480 msgr2=0x7fadcc0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.477+0000 7fadd3c00640 1 --2- 172.21.15.5:0/4186750341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b5480 0x7fadcc0b4b50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009870 tx=0x7fadb802a160 comp rx=0 tx=0).stop 2024-04-26T21:37:43.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== osd.3 v2:172.21.15.5:6822/3678222192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92e8078af0 con 0x7f92e8075fe0 2024-04-26T21:37:43.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7fadd3c00640 1 -- 172.21.15.5:0/4186750341 shutdown_connections 2024-04-26T21:37:43.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7fadd3c00640 1 --2- 172.21.15.5:0/4186750341 >> v2:172.21.15.5:3300/0 conn(0x7fadcc1507f0 0x7fadcc150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7fadd3c00640 1 --2- 172.21.15.5:0/4186750341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b5480 0x7fadcc0b4b50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7fadd3c00640 1 -- 172.21.15.5:0/4186750341 >> 172.21.15.5:0/4186750341 conn(0x7fadcc068720 msgr2=0x7fadcc0be080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7fadd3c00640 1 -- 172.21.15.5:0/4186750341 shutdown_connections 2024-04-26T21:37:43.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7fadd3c00640 1 -- 172.21.15.5:0/4186750341 wait complete. 2024-04-26T21:37:43.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.481+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 --> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f42f806a520 con 0x7f42d80760e0 2024-04-26T21:37:43.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.484+0000 7fadd3c00640 1 Processor -- start 2024-04-26T21:37:43.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.484+0000 7f9307e00640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f92e806c8f0 0x7f92e806edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9308146360 tx=0x7f92f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.484+0000 7fadd3c00640 1 -- start start 2024-04-26T21:37:43.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.485+0000 7fadd3c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0bea00 0x7fadcc14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.485+0000 7fadd3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc1507f0 0x7fadcc06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.485+0000 7fadd3c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc1e2a20 0x7fadcc070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.501 INFO:teuthology.orchestra.run.smithi005.stdout:55834574859 2024-04-26T21:37:43.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.486+0000 7f42ee000640 1 -- 172.21.15.5:0/2501685235 <== osd.4 v2:172.21.15.112:6824/2443506001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f42f806a520 con 0x7f42d80760e0 2024-04-26T21:37:43.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T21:37:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.486+0000 7fadd1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc1e2a20 0x7fadcc070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.486+0000 7fadd3c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0b1940 con 0x7fadcc1e2a20 2024-04-26T21:37:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.486+0000 7fadd3c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1511b0 con 0x7fadcc1507f0 2024-04-26T21:37:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.486+0000 7fadd3c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc150300 con 0x7fadcc0bea00 2024-04-26T21:37:43.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.486+0000 7fadd1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc1e2a20 0x7fadcc070270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49458/0 (socket says 172.21.15.5:49458) 2024-04-26T21:37:43.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.486+0000 7fadd1c00640 1 -- 172.21.15.5:0/155119146 learned_addr learned my addr 172.21.15.5:0/155119146 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.487+0000 7fadcbe00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc1507f0 0x7fadcc06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.504 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-04-26T21:37:43.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.487+0000 7fadd1200640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0bea00 0x7fadcc14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.487+0000 7fadd1c00640 1 -- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0bea00 msgr2=0x7fadcc14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.487+0000 7fadd1c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0bea00 0x7fadcc14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.487+0000 7fadd1c00640 1 -- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc1507f0 msgr2=0x7fadcc06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.487+0000 7fadd1c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc1507f0 0x7fadcc06fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.487+0000 7fadd1c00640 1 -- 172.21.15.5:0/155119146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc071920 con 0x7fadcc1e2a20 2024-04-26T21:37:43.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7fadcbe00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc1507f0 0x7fadcc06fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:43.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T21:37:43.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7fadd1c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc1e2a20 0x7fadcc070270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fadc400b9a0 tx=0x7fadc400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f42d80760e0 msgr2=0x7f42d8078520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7f42fd200640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f42d80760e0 0x7f42d8078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42d806c970 msgr2=0x7f42d806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7f42fd200640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f42d806c970 0x7f42d806ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009560 tx=0x7f42e802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80bea00 msgr2=0x7f42f80aa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7f42fd200640 1 --2- 172.21.15.5:0/2501685235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80bea00 0x7f42f80aa8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f42e400d550 tx=0x7f42e400da10 comp rx=0 tx=0).stop 2024-04-26T21:37:43.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.488+0000 7f42f6800640 1 -- 172.21.15.5:0/2501685235 reap_dead start 2024-04-26T21:37:43.508 INFO:teuthology.orchestra.run.smithi005.stdout:55834574859 2024-04-26T21:37:43.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T21:37:43.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 shutdown_connections 2024-04-26T21:37:43.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 >> 172.21.15.5:0/2501685235 conn(0x7f42f8068720 msgr2=0x7f42f80bb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4019070 con 0x7fadcc1e2a20 2024-04-26T21:37:43.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc400cbc0 con 0x7fadcc1e2a20 2024-04-26T21:37:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4014440 con 0x7fadcc1e2a20 2024-04-26T21:37:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1e2ee0 con 0x7fadcc1e2a20 2024-04-26T21:37:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 shutdown_connections 2024-04-26T21:37:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.490+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc14ca30 con 0x7fadcc1e2a20 2024-04-26T21:37:43.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.491+0000 7f42fd200640 1 -- 172.21.15.5:0/2501685235 wait complete. 2024-04-26T21:37:43.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.491+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fadcc075db0 con 0x7fadcc1e2a20 2024-04-26T21:37:43.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.493+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fadc401c070 con 0x7fadcc1e2a20 2024-04-26T21:37:43.511 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2024-04-26T21:37:43.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T21:37:43.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.494+0000 7fadc8c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadac06c970 0x7fadac06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.495+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fadc408c210 con 0x7fadcc1e2a20 2024-04-26T21:37:43.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.495+0000 7fadc8c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7fadac0760e0 0x7fadac078520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.495+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 --> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadc4018ec0 con 0x7fadac0760e0 2024-04-26T21:37:43.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.495+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fadc408c6f0 con 0x7fadcc1e2a20 2024-04-26T21:37:43.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.496+0000 7fadcbe00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7fadac0760e0 0x7fadac078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.514 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-04-26T21:37:43.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T21:37:43.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.496+0000 7fadd1200640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadac06c970 0x7fadac06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.497+0000 7fadcbe00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7fadac0760e0 0x7fadac078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.498+0000 7fadd1200640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadac06c970 0x7fadac06ee30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fadc0000f60 tx=0x7fadc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.499+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== osd.6 v2:172.21.15.112:6800/3731383077 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fadc4018ec0 con 0x7fadac0760e0 2024-04-26T21:37:43.516 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2024-04-26T21:37:43.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T21:37:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.515+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 --> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9308075db0 con 0x7f92e8075fe0 2024-04-26T21:37:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.515+0000 7f9304c00640 1 -- 172.21.15.5:0/2515455357 <== osd.3 v2:172.21.15.5:6822/3678222192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9308075db0 con 0x7f92e8075fe0 2024-04-26T21:37:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 --> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fadcc0b5d80 con 0x7fadac0760e0 2024-04-26T21:37:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7f92e8075fe0 msgr2=0x7f92e8078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7f92e8075fe0 0x7f92e8078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f92e806c8f0 msgr2=0x7f92e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f92e806c8f0 0x7f92e806edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9308146360 tx=0x7f92f4009040 comp rx=0 tx=0).stop 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b7b00 msgr2=0x7f93081dbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 --2- 172.21.15.5:0/2515455357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b7b00 0x7f93081dbe90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e810 tx=0x7f92fc00ecd0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930d800640 1 -- 172.21.15.5:0/2515455357 reap_dead start 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 shutdown_connections 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 >> 172.21.15.5:0/2515455357 conn(0x7f9308068720 msgr2=0x7f93080bb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 shutdown_connections 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7f930f800640 1 -- 172.21.15.5:0/2515455357 wait complete. 2024-04-26T21:37:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.516+0000 7fadc8c00640 1 -- 172.21.15.5:0/155119146 <== osd.6 v2:172.21.15.112:6800/3731383077 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fadcc0b5d80 con 0x7fadac0760e0 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7fadac0760e0 msgr2=0x7fadac078520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7fadac0760e0 0x7fadac078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadac06c970 msgr2=0x7fadac06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadac06c970 0x7fadac06ee30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fadc0000f60 tx=0x7fadc0009040 comp rx=0 tx=0).stop 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc1e2a20 msgr2=0x7fadcc070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 --2- 172.21.15.5:0/155119146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc1e2a20 0x7fadcc070270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fadc400b9a0 tx=0x7fadc400be60 comp rx=0 tx=0).stop 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd1c00640 1 -- 172.21.15.5:0/155119146 reap_dead start 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 shutdown_connections 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 >> 172.21.15.5:0/155119146 conn(0x7fadcc068720 msgr2=0x7fadcc14e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 shutdown_connections 2024-04-26T21:37:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.517+0000 7fadd3c00640 1 -- 172.21.15.5:0/155119146 wait complete. 2024-04-26T21:37:43.544 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-04-26T21:37:43.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T21:37:43.549 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-04-26T21:37:43.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T21:37:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.811+0000 7f17f1400640 1 Processor -- start 2024-04-26T21:37:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.811+0000 7f17f1400640 1 -- start start 2024-04-26T21:37:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.812+0000 7fc42b000640 1 Processor -- start 2024-04-26T21:37:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.813+0000 7f17f1400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17ec0b69b0 0x7f17ec148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.812+0000 7fc42b000640 1 -- start start 2024-04-26T21:37:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.813+0000 7fc42b000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4240b08e0 0x7fc4240b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.814+0000 7fc42b000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4241452e0 0x7fc42414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.814+0000 7fc42b000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4240b0cc0 con 0x7fc4240b2b10 2024-04-26T21:37:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.814+0000 7fc42b000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc42413ed30 con 0x7fc4240b08e0 2024-04-26T21:37:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.814+0000 7fc42b000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc4240b19f0 con 0x7fc4241452e0 2024-04-26T21:37:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.814+0000 7f17f1400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17ec1421a0 0x7f17ec1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7fc423400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc4240b2b10 0x7fc424144bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56172/0 (socket says 172.21.15.5:56172) 2024-04-26T21:37:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7fc423400640 1 -- 172.21.15.5:0/2497365451 learned_addr learned my addr 172.21.15.5:0/2497365451 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7f17f1400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17ec0b6d90 con 0x7f17ec0b87d0 2024-04-26T21:37:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7f17f1400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec0b8c20 con 0x7f17ec1421a0 2024-04-26T21:37:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7f17f1400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec1487d0 con 0x7f17ec0b69b0 2024-04-26T21:37:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7fc429000640 1 --2- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4241452e0 0x7fc42414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7fc423e00640 1 --2- 172.21.15.5:0/2497365451 >> v2:172.21.15.112:3300/0 conn(0x7fc4240b08e0 0x7fc4240b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.815+0000 7ff268a00640 1 Processor -- start 2024-04-26T21:37:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7fc422a00640 1 -- 172.21.15.5:0/2497365451 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921669724 0 0) 0x7fc4240b0cc0 con 0x7fc4240b2b10 2024-04-26T21:37:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7f17eb400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17ec0b87d0 0x7f17ec0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56184/0 (socket says 172.21.15.5:56184) 2024-04-26T21:37:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7f17eb400640 1 -- 172.21.15.5:0/2691013621 learned_addr learned my addr 172.21.15.5:0/2691013621 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7f17f0a00640 1 --2- 172.21.15.5:0/2691013621 >> v2:172.21.15.5:3300/0 conn(0x7f17ec1421a0 0x7f17ec1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7f17ebe00640 1 --2- 172.21.15.5:0/2691013621 >> v2:172.21.15.112:3300/0 conn(0x7f17ec0b69b0 0x7f17ec148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7f17f0a00640 1 -- 172.21.15.5:0/2691013621 >> v2:172.21.15.112:3300/0 conn(0x7f17ec0b69b0 msgr2=0x7f17ec148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7f17f0a00640 1 --2- 172.21.15.5:0/2691013621 >> v2:172.21.15.112:3300/0 conn(0x7f17ec0b69b0 0x7f17ec148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7ff268a00640 1 -- start start 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7ff268a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2640badf0 0x7ff264142180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7ff268a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7ff268a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2640b62c0 con 0x7ff2640b5760 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7ff268a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff2640b68d0 con 0x7ff2640badf0 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7ff268a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff2640bb1d0 con 0x7ff26414c070 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.818+0000 7ff263200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.819+0000 7ff263200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49048/0 (socket says 172.21.15.5:49048) 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7fc422a00640 1 -- 172.21.15.5:0/2497365451 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc408003520 con 0x7fc4240b2b10 2024-04-26T21:37:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7fc423e00640 1 -- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4241452e0 msgr2=0x7fc42414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7fc423e00640 1 --2- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4241452e0 0x7fc42414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7fc423e00640 1 -- 172.21.15.5:0/2497365451 >> v1:172.21.15.5:6789/0 conn(0x7fc4240b2b10 legacy=0x7fc424144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.816+0000 7fc423e00640 1 -- 172.21.15.5:0/2497365451 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4240b1430 con 0x7fc4240b08e0 2024-04-26T21:37:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.819+0000 7ff263200640 1 -- 172.21.15.5:0/3296745793 learned_addr learned my addr 172.21.15.5:0/3296745793 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.819+0000 7ff262800640 1 --2- 172.21.15.5:0/3296745793 >> v2:172.21.15.112:3300/0 conn(0x7ff2640badf0 0x7ff264142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.819+0000 7fc423e00640 1 --2- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4240b08e0 0x7fc4240b25d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097d0 tx=0x7fc41402e5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a57a7e86842a1d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.817+0000 7f17f0a00640 1 -- 172.21.15.5:0/2691013621 >> v1:172.21.15.5:6789/0 conn(0x7f17ec0b87d0 legacy=0x7f17ec0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.818+0000 7f17f0a00640 1 -- 172.21.15.5:0/2691013621 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec148ab0 con 0x7f17ec1421a0 2024-04-26T21:37:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.820+0000 7ff263200640 1 -- 172.21.15.5:0/3296745793 >> v2:172.21.15.112:3300/0 conn(0x7ff2640badf0 msgr2=0x7ff264142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.820+0000 7ff263200640 1 --2- 172.21.15.5:0/3296745793 >> v2:172.21.15.112:3300/0 conn(0x7ff2640badf0 0x7ff264142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.820+0000 7f17f0a00640 1 --2- 172.21.15.5:0/2691013621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1425d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0becb0 tx=0x7f17e402a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5a4f2e26b7566 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.821+0000 7ff263200640 1 -- 172.21.15.5:0/3296745793 >> v1:172.21.15.5:6789/0 conn(0x7ff2640b5760 legacy=0x7ff26414b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.821+0000 7ff263200640 1 -- 172.21.15.5:0/3296745793 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2640b6560 con 0x7ff26414c070 2024-04-26T21:37:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.821+0000 7f17eaa00640 1 -- 172.21.15.5:0/2691013621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4034020 con 0x7f17ec1421a0 2024-04-26T21:37:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.822+0000 7f17eaa00640 1 -- 172.21.15.5:0/2691013621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e4030600 con 0x7f17ec1421a0 2024-04-26T21:37:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.822+0000 7f17eaa00640 1 -- 172.21.15.5:0/2691013621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4030a10 con 0x7f17ec1421a0 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.821+0000 7fc422a00640 1 -- 172.21.15.5:0/2497365451 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41403a070 con 0x7fc4240b08e0 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.821+0000 7fc422a00640 1 -- 172.21.15.5:0/2497365451 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc414033710 con 0x7fc4240b08e0 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.821+0000 7fc422a00640 1 -- 172.21.15.5:0/2497365451 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414033b20 con 0x7fc4240b08e0 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.822+0000 7fc42b000640 1 -- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4240b08e0 msgr2=0x7fc4240b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.822+0000 7fc42b000640 1 --2- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4240b08e0 0x7fc4240b25d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097d0 tx=0x7fc41402e5f0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.822+0000 7fc42b000640 1 -- 172.21.15.5:0/2497365451 shutdown_connections 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.823+0000 7fc42b000640 1 --2- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4241452e0 0x7fc42414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.823+0000 7fc42b000640 1 --2- 172.21.15.5:0/2497365451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4240b08e0 0x7fc4240b25d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.823+0000 7f17f1400640 1 -- 172.21.15.5:0/2691013621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 msgr2=0x7f17ec1425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.823+0000 7f17f1400640 1 --2- 172.21.15.5:0/2691013621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1425d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0becb0 tx=0x7f17e402a910 comp rx=0 tx=0).stop 2024-04-26T21:37:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.823+0000 7fc42b000640 1 -- 172.21.15.5:0/2497365451 >> 172.21.15.5:0/2497365451 conn(0x7fc42406c4e0 msgr2=0x7fc42406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.823+0000 7fc42b000640 1 -- 172.21.15.5:0/2497365451 shutdown_connections 2024-04-26T21:37:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7f17f1400640 1 -- 172.21.15.5:0/2691013621 shutdown_connections 2024-04-26T21:37:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7fc42b000640 1 -- 172.21.15.5:0/2497365451 wait complete. 2024-04-26T21:37:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7f17f1400640 1 --2- 172.21.15.5:0/2691013621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1425d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7f17f1400640 1 --2- 172.21.15.5:0/2691013621 >> v2:172.21.15.112:3300/0 conn(0x7f17ec0b69b0 0x7f17ec148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7f17f1400640 1 -- 172.21.15.5:0/2691013621 >> 172.21.15.5:0/2691013621 conn(0x7f17ec0bde50 msgr2=0x7f17ec0be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7ff263200640 1 --2- 172.21.15.5:0/3296745793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641426c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff250009870 tx=0x7ff25002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b27135a0032d247a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7f17f1400640 1 -- 172.21.15.5:0/2691013621 shutdown_connections 2024-04-26T21:37:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7f17f1400640 1 -- 172.21.15.5:0/2691013621 wait complete. 2024-04-26T21:37:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.824+0000 7f13e7200640 1 Processor -- start 2024-04-26T21:37:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.825+0000 7ff261400640 1 -- 172.21.15.5:0/3296745793 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250037070 con 0x7ff26414c070 2024-04-26T21:37:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.825+0000 7ff261400640 1 -- 172.21.15.5:0/3296745793 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff250032440 con 0x7ff26414c070 2024-04-26T21:37:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.825+0000 7ff261400640 1 -- 172.21.15.5:0/3296745793 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250032810 con 0x7ff26414c070 2024-04-26T21:37:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.825+0000 7f13e7200640 1 -- start start 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 -- 172.21.15.5:0/3296745793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 msgr2=0x7ff2641426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 --2- 172.21.15.5:0/3296745793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641426c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff250009870 tx=0x7ff25002a1c0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 -- 172.21.15.5:0/3296745793 shutdown_connections 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 --2- 172.21.15.5:0/3296745793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641426c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 --2- 172.21.15.5:0/3296745793 >> v2:172.21.15.112:3300/0 conn(0x7ff2640badf0 0x7ff264142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 -- 172.21.15.5:0/3296745793 >> 172.21.15.5:0/3296745793 conn(0x7ff2640684b0 msgr2=0x7ff2640688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 -- 172.21.15.5:0/3296745793 shutdown_connections 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7ff268a00640 1 -- 172.21.15.5:0/3296745793 wait complete. 2024-04-26T21:37:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.826+0000 7fc42b000640 1 Processor -- start 2024-04-26T21:37:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7f17f1400640 1 Processor -- start 2024-04-26T21:37:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7f13e7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e0038cb0 0x7f13e00cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7f13e7200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13e00caab0 0x7f13e00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.827+0000 7fc42b000640 1 -- start start 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7fc42b000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4240b08e0 0x7fc42413d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7fc42b000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4240b2b10 0x7fc42413c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7fc42b000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4241452e0 0x7fc4241e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7fc42b000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc424144570 con 0x7fc4240b2b10 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7fc42b000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc4240b10c0 con 0x7fc4241452e0 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.828+0000 7fc42b000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc4241446f0 con 0x7fc4240b08e0 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.829+0000 7fc429000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4241452e0 0x7fc4241e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.829+0000 7fc429000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4241452e0 0x7fc4241e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54034/0 (socket says 172.21.15.5:54034) 2024-04-26T21:37:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.829+0000 7fc429000640 1 -- 172.21.15.5:0/4144516579 learned_addr learned my addr 172.21.15.5:0/4144516579 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.829+0000 7f13e7200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13e00c09e0 0x7f13e00c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.830+0000 7f13e7200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f13e0036d80 con 0x7f13e00caab0 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.830+0000 7f13e7200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f13e003a590 con 0x7f13e00c09e0 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.829+0000 7f13e5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e0038cb0 0x7f13e00cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.830+0000 7f13e5e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e0038cb0 0x7f13e00cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49064/0 (socket says 172.21.15.5:49064) 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.830+0000 7f13e5e00640 1 -- 172.21.15.5:0/3517644291 learned_addr learned my addr 172.21.15.5:0/3517644291 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.830+0000 7f13e7200640 1 -- 172.21.15.5:0/3517644291 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f13e0039090 con 0x7f13e0038cb0 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.831+0000 7f13e5400640 1 --2- 172.21.15.5:0/3517644291 >> v2:172.21.15.5:3300/0 conn(0x7f13e00caab0 0x7f13e00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.831+0000 7ff268a00640 1 Processor -- start 2024-04-26T21:37:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.832+0000 7fc423400640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4240b2b10 0x7fc42413c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.833+0000 7fc423400640 1 -- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4240b08e0 msgr2=0x7fc42413d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.833+0000 7fc423400640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4240b08e0 0x7fc42413d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.833+0000 7fc423400640 1 -- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4241452e0 msgr2=0x7fc4241e1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.833+0000 7fc423400640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4241452e0 0x7fc4241e1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.833+0000 7fc423400640 1 -- 172.21.15.5:0/4144516579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42413f6b0 con 0x7fc4240b2b10 2024-04-26T21:37:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.833+0000 7ff268a00640 1 -- start start 2024-04-26T21:37:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.832+0000 7f13e5e00640 1 -- 172.21.15.5:0/3517644291 >> v2:172.21.15.112:3300/0 conn(0x7f13e00c09e0 msgr2=0x7f13e00c0e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:37:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.832+0000 7f13e5e00640 1 --2- 172.21.15.5:0/3517644291 >> v2:172.21.15.112:3300/0 conn(0x7f13e00c09e0 0x7f13e00c0e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.832+0000 7f13e5e00640 1 -- 172.21.15.5:0/3517644291 >> v2:172.21.15.5:3300/0 conn(0x7f13e00caab0 msgr2=0x7f13e00caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.832+0000 7f13e5e00640 1 --2- 172.21.15.5:0/3517644291 >> v2:172.21.15.5:3300/0 conn(0x7f13e00caab0 0x7f13e00caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.832+0000 7f13e5e00640 1 -- 172.21.15.5:0/3517644291 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e002bdb0 con 0x7f13e0038cb0 2024-04-26T21:37:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.833+0000 7f17f1400640 1 -- start start 2024-04-26T21:37:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.834+0000 7f17f1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17ec0b69b0 0x7f17ec144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.834+0000 7f17f1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17ec0b87d0 0x7f17ec1e2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.834+0000 7f17f1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.834+0000 7f17f1400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0ba5a0 con 0x7f17ec1421a0 2024-04-26T21:37:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.835+0000 7f17f1400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec142b10 con 0x7f17ec0b69b0 2024-04-26T21:37:43.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.835+0000 7f17f1400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec0ba720 con 0x7f17ec0b87d0 2024-04-26T21:37:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.835+0000 7f13e5e00640 1 --2- 172.21.15.5:0/3517644291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e0038cb0 0x7f13e00cde20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13e003c420 tx=0x7f13d802e4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd44ae285afbe08a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.836+0000 7f17f0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.836+0000 7ff268a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640b5760 0x7ff264148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.836+0000 7f17f0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1e2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49494/0 (socket says 172.21.15.5:49494) 2024-04-26T21:37:43.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.836+0000 7f13e4a00640 1 -- 172.21.15.5:0/3517644291 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d803a070 con 0x7f13e0038cb0 2024-04-26T21:37:43.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.836+0000 7f13e4a00640 1 -- 172.21.15.5:0/3517644291 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8033710 con 0x7f13e0038cb0 2024-04-26T21:37:43.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.836+0000 7fc423400640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4240b2b10 0x7fc42413c0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4240b2f10 tx=0x7fc410001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7ff268a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640badf0 0x7ff2641e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.836+0000 7f13e4a00640 1 -- 172.21.15.5:0/3517644291 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8033ae0 con 0x7f13e0038cb0 2024-04-26T21:37:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7f17f0a00640 1 -- 172.21.15.5:0/1750777904 learned_addr learned my addr 172.21.15.5:0/1750777904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7fc41be00640 1 -- 172.21.15.5:0/4144516579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41000f630 con 0x7fc4240b2b10 2024-04-26T21:37:43.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7fc41be00640 1 -- 172.21.15.5:0/4144516579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc410015070 con 0x7fc4240b2b10 2024-04-26T21:37:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7f13e7200640 1 -- 172.21.15.5:0/3517644291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e0038cb0 msgr2=0x7f13e00cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7ff268a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7f13e7200640 1 --2- 172.21.15.5:0/3517644291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e0038cb0 0x7f13e00cde20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13e003c420 tx=0x7f13d802e4f0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7f17ebe00640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17ec0b69b0 0x7f17ec144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7ff268a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640ba3e0 con 0x7ff2640b5760 2024-04-26T21:37:43.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7ff268a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640ba260 con 0x7ff2640badf0 2024-04-26T21:37:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7f13e7200640 1 -- 172.21.15.5:0/3517644291 shutdown_connections 2024-04-26T21:37:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7f13e7200640 1 --2- 172.21.15.5:0/3517644291 >> v2:172.21.15.112:3300/0 conn(0x7f13e00c09e0 0x7f13e00c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7f13e7200640 1 --2- 172.21.15.5:0/3517644291 >> v2:172.21.15.5:3300/0 conn(0x7f13e00caab0 0x7f13e00caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7f13e7200640 1 --2- 172.21.15.5:0/3517644291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e0038cb0 0x7f13e00cde20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7f13e7200640 1 -- 172.21.15.5:0/3517644291 >> 172.21.15.5:0/3517644291 conn(0x7f13e003cab0 msgr2=0x7f13e003cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4241e5340 con 0x7fc4240b2b10 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7ff268a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff2641434c0 con 0x7ff26414c070 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.837+0000 7ff263200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7ff263200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49080/0 (socket says 172.21.15.5:49080) 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7ff263200640 1 -- 172.21.15.5:0/1821215069 learned_addr learned my addr 172.21.15.5:0/1821215069 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7ff263200640 1 -- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640badf0 msgr2=0x7ff2641e48f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7ff263200640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640badf0 0x7ff2641e48f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7ff263200640 1 -- 172.21.15.5:0/1821215069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640b5760 msgr2=0x7ff264148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7ff263200640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640b5760 0x7ff264148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7ff263200640 1 -- 172.21.15.5:0/1821215069 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264145bf0 con 0x7ff26414c070 2024-04-26T21:37:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.838+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4241e5900 con 0x7fc4240b2b10 2024-04-26T21:37:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.839+0000 7fc41be00640 1 -- 172.21.15.5:0/4144516579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41000fa50 con 0x7fc4240b2b10 2024-04-26T21:37:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.839+0000 7f13e7200640 1 -- 172.21.15.5:0/3517644291 shutdown_connections 2024-04-26T21:37:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.840+0000 7f17ebe00640 1 -- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17ec0b87d0 msgr2=0x7f17ec1e2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.839+0000 7f17eb400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17ec0b87d0 0x7f17ec1e2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.840+0000 7f17ebe00640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17ec0b87d0 0x7f17ec1e2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.840+0000 7f17ebe00640 1 -- 172.21.15.5:0/1750777904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 msgr2=0x7f17ec1e2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.840+0000 7f17ebe00640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1e2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.840+0000 7f17ebe00640 1 -- 172.21.15.5:0/1750777904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec143750 con 0x7f17ec0b69b0 2024-04-26T21:37:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.840+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc424075db0 con 0x7fc4240b2b10 2024-04-26T21:37:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.840+0000 7f13e7200640 1 -- 172.21.15.5:0/3517644291 wait complete. 2024-04-26T21:37:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.841+0000 7ff263200640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641ee4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff250009870 tx=0x7ff2500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.841+0000 7ff25aa00640 1 -- 172.21.15.5:0/1821215069 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250041020 con 0x7ff26414c070 2024-04-26T21:37:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.842+0000 7ff25aa00640 1 -- 172.21.15.5:0/1821215069 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25003d640 con 0x7ff26414c070 2024-04-26T21:37:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.841+0000 7f17f0a00640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1e2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:37:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.842+0000 7f17ebe00640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17ec0b69b0 0x7f17ec144d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d5f0 tx=0x7f17dc00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.843+0000 7f17e3e00640 1 -- 172.21.15.5:0/1750777904 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0125f0 con 0x7f17ec0b69b0 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.843+0000 7f17eb400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17ec0b87d0 0x7f17ec1e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.843+0000 7f17e3e00640 1 -- 172.21.15.5:0/1750777904 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc019070 con 0x7f17ec0b69b0 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.843+0000 7f17e3e00640 1 -- 172.21.15.5:0/1750777904 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0129d0 con 0x7f17ec0b69b0 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.844+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec143a30 con 0x7f17ec0b69b0 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.844+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec14c540 con 0x7f17ec0b69b0 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.844+0000 7f13e7200640 1 Processor -- start 2024-04-26T21:37:43.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.845+0000 7f13e7200640 1 -- start start 2024-04-26T21:37:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.844+0000 7fc41be00640 1 -- 172.21.15.5:0/4144516579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc41000fbf0 con 0x7fc4240b2b10 2024-04-26T21:37:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.843+0000 7ff25aa00640 1 -- 172.21.15.5:0/1821215069 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250037040 con 0x7ff26414c070 2024-04-26T21:37:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.844+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26414b070 con 0x7ff26414c070 2024-04-26T21:37:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.845+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff264146410 con 0x7ff26414c070 2024-04-26T21:37:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.846+0000 7f3f09600640 1 Processor -- start 2024-04-26T21:37:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.847+0000 7f3f09600640 1 -- start start 2024-04-26T21:37:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.847+0000 7f13e7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e0038cb0 0x7f13e00cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.847+0000 7f13e7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e00c09e0 0x7f13e00cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.847+0000 7f13e7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13e00caab0 0x7f13e015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.847+0000 7f13e7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13e00ce360 con 0x7f13e0038cb0 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.847+0000 7f13e7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f13e00ca590 con 0x7f13e00caab0 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.847+0000 7f13e7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f13e0039cb0 con 0x7f13e00c09e0 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f13e5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e00c09e0 0x7f13e00cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f3f09600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f040b6d50 0x7f3f040b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f3f09600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f0414bcc0 0x7f3f0414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f3f09600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040b7130 con 0x7f3f04148dd0 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f3f09600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3f040b0070 con 0x7f3f040b6d50 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f3f09600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3f040af490 con 0x7f3f0414bcc0 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.849+0000 7f3f02a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f040b6d50 0x7f3f040b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f13e6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13e00caab0 0x7f13e015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f13e6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13e00caab0 0x7f13e015da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54050/0 (socket says 172.21.15.5:54050) 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.848+0000 7f13e6800640 1 -- 172.21.15.5:0/2770468043 learned_addr learned my addr 172.21.15.5:0/2770468043 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.849+0000 7f3f02a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3f040b6d50 0x7f3f040b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54064/0 (socket says 172.21.15.5:54064) 2024-04-26T21:37:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.846+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ec075db0 con 0x7f17ec0b69b0 2024-04-26T21:37:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.849+0000 7f3f02a00640 1 -- 172.21.15.5:0/3905819785 learned_addr learned my addr 172.21.15.5:0/3905819785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.849+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff264075db0 con 0x7ff26414c070 2024-04-26T21:37:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f13e5400640 1 -- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13e00caab0 msgr2=0x7f13e015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f13e5400640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13e00caab0 0x7f13e015da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f13e5400640 1 -- 172.21.15.5:0/2770468043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e0038cb0 msgr2=0x7f13e00cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f13e5400640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e0038cb0 0x7f13e00cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f13e5400640 1 -- 172.21.15.5:0/2770468043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e00cca90 con 0x7f13e00c09e0 2024-04-26T21:37:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7fc41be00640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc40406cb40 0x7fc40406f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7fc41be00640 1 -- 172.21.15.5:0/4144516579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc41000f810 con 0x7fc4240b2b10 2024-04-26T21:37:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.851+0000 7fc423e00640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc40406cb40 0x7fc40406f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.851+0000 7ff25aa00640 1 -- 172.21.15.5:0/1821215069 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff250044020 con 0x7ff26414c070 2024-04-26T21:37:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f3f02a00640 1 -- 172.21.15.5:0/3905819785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f0414bcc0 msgr2=0x7f3f0414c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f3f02a00640 1 --2- 172.21.15.5:0/3905819785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f0414bcc0 0x7f3f0414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f3f02a00640 1 -- 172.21.15.5:0/3905819785 >> v1:172.21.15.5:6789/0 conn(0x7f3f04148dd0 legacy=0x7f3f04149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.850+0000 7f3f02a00640 1 -- 172.21.15.5:0/3905819785 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f040aec60 con 0x7f3f040b6d50 2024-04-26T21:37:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.852+0000 7f3f02a00640 1 --2- 172.21.15.5:0/3905819785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 0x7f3f040b07a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009870 tx=0x7f3ef002a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f11ccca7ef10ea05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.853+0000 7ff25aa00640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff24406c8f0 0x7ff24406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.853+0000 7f13e5400640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e00c09e0 0x7f13e00cd490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13d400e8a0 tx=0x7f13d400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.853+0000 7ff25aa00640 1 -- 172.21.15.5:0/1821215069 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff2500abc70 con 0x7ff26414c070 2024-04-26T21:37:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.853+0000 7f14ede00640 1 Processor -- start 2024-04-26T21:37:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.853+0000 7f17e3e00640 1 -- 172.21.15.5:0/1750777904 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17dc012b70 con 0x7f17ec0b69b0 2024-04-26T21:37:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.853+0000 7f14ede00640 1 -- start start 2024-04-26T21:37:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.854+0000 7ff262800640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff24406c8f0 0x7ff24406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.854+0000 7fc423e00640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc40406cb40 0x7fc40406f000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc414037000 tx=0x7fc414032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f17e3e00640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17cc06c940 0x7f17cc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f17e3e00640 1 -- 172.21.15.5:0/1750777904 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f17dc08cce0 con 0x7f17ec0b69b0 2024-04-26T21:37:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f14ede00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e80b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f14ede00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14e8146f90 0x7f14e80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f14ede00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e80b7130 con 0x7f14e80b3e20 2024-04-26T21:37:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f14ede00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f14e80b1580 con 0x7f14e8146f90 2024-04-26T21:37:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f14ede00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f14e80b17d0 con 0x7f14e80b6d50 2024-04-26T21:37:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f14e7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14e8146f90 0x7f14e80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7ff262800640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff24406c8f0 0x7ff24406edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00e190 tx=0x7ff25c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.855+0000 7f17eb400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17cc06c940 0x7f17cc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7f14e7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14e8146f90 0x7f14e80b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49514/0 (socket says 172.21.15.5:49514) 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7f14e7400640 1 -- 172.21.15.5:0/4216322249 learned_addr learned my addr 172.21.15.5:0/4216322249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7f14e6a00640 1 --2- 172.21.15.5:0/4216322249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e80b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7f14e7400640 1 -- 172.21.15.5:0/4216322249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 msgr2=0x7f14e80b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7f14e7400640 1 --2- 172.21.15.5:0/4216322249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e80b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7f14e7400640 1 -- 172.21.15.5:0/4216322249 >> v1:172.21.15.112:6789/0 conn(0x7f14e80b3e20 legacy=0x7f14e8146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7f14e7400640 1 -- 172.21.15.5:0/4216322249 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e80b1160 con 0x7f14e8146f90 2024-04-26T21:37:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.856+0000 7fc41be00640 1 -- 172.21.15.5:0/4144516579 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc410059f90 con 0x7fc4240b2b10 2024-04-26T21:37:43.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.857+0000 7f17eb400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17cc06c940 0x7f17cc06ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17ec073a00 tx=0x7f17d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.858+0000 7f14e7400640 1 --2- 172.21.15.5:0/4216322249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e8146f90 0x7f14e80b2240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009e50 tx=0x7f14d802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68493feea0e539a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.858+0000 7f14e5600640 1 -- 172.21.15.5:0/4216322249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8036070 con 0x7f14e8146f90 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.858+0000 7f14e5600640 1 -- 172.21.15.5:0/4216322249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8031600 con 0x7f14e8146f90 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.858+0000 7f14e5600640 1 -- 172.21.15.5:0/4216322249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80319d0 con 0x7f14e8146f90 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.859+0000 7f14ede00640 1 -- 172.21.15.5:0/4216322249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e8146f90 msgr2=0x7f14e80b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.859+0000 7f14ede00640 1 --2- 172.21.15.5:0/4216322249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e8146f90 0x7f14e80b2240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009e50 tx=0x7f14d802a680 comp rx=0 tx=0).stop 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.860+0000 7f14ede00640 1 -- 172.21.15.5:0/4216322249 shutdown_connections 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.860+0000 7f14ede00640 1 --2- 172.21.15.5:0/4216322249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e8146f90 0x7f14e80b2240 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.860+0000 7f14ede00640 1 --2- 172.21.15.5:0/4216322249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e80b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.860+0000 7f14ede00640 1 -- 172.21.15.5:0/4216322249 >> 172.21.15.5:0/4216322249 conn(0x7f14e806c720 msgr2=0x7f14e806cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.860+0000 7f14ede00640 1 -- 172.21.15.5:0/4216322249 shutdown_connections 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.860+0000 7f14ede00640 1 -- 172.21.15.5:0/4216322249 wait complete. 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.862+0000 7f14ede00640 1 Processor -- start 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.863+0000 7f14ede00640 1 -- start start 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14ede00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e80b3e20 0x7f14e8149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14ede00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e8147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14ede00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e8146f90 0x7f14e8148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14ede00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80b0cc0 con 0x7f14e80b3e20 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14ede00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80b0b40 con 0x7f14e8146f90 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14ede00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f14e80b6350 con 0x7f14e80b6d50 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e80b3e20 0x7f14e8149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e80b3e20 0x7f14e8149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49522/0 (socket says 172.21.15.5:49522) 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.864+0000 7f14e6a00640 1 -- 172.21.15.5:0/2235299757 learned_addr learned my addr 172.21.15.5:0/2235299757 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e7400640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e8146f90 0x7f14e8148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e6000640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e8147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e6a00640 1 -- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 msgr2=0x7f14e8147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e6a00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e8147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e6a00640 1 -- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e8146f90 msgr2=0x7f14e8148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e6a00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e8146f90 0x7f14e8148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e6a00640 1 -- 172.21.15.5:0/2235299757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e8147610 con 0x7f14e80b3e20 2024-04-26T21:37:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.865+0000 7f14e7400640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e8146f90 0x7f14e8148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.866+0000 7f14e6a00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e80b3e20 0x7f14e8149e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14e000d800 tx=0x7f14e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.866+0000 7f14df400640 1 -- 172.21.15.5:0/2235299757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e000b6c0 con 0x7f14e80b3e20 2024-04-26T21:37:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.866+0000 7f14df400640 1 -- 172.21.15.5:0/2235299757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e0019070 con 0x7f14e80b3e20 2024-04-26T21:37:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.866+0000 7f14df400640 1 -- 172.21.15.5:0/2235299757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e000ba80 con 0x7f14e80b3e20 2024-04-26T21:37:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.866+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e81493a0 con 0x7f14e80b3e20 2024-04-26T21:37:43.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.866+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e8073130 con 0x7f14e80b3e20 2024-04-26T21:37:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.868+0000 7f3f01600640 1 -- 172.21.15.5:0/3905819785 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0037070 con 0x7f3f040b6d50 2024-04-26T21:37:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.868+0000 7f3f01600640 1 -- 172.21.15.5:0/3905819785 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef002ae00 con 0x7f3f040b6d50 2024-04-26T21:37:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.868+0000 7f3f01600640 1 -- 172.21.15.5:0/3905819785 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0032660 con 0x7f3f040b6d50 2024-04-26T21:37:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.868+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e814ccd0 con 0x7f14e80b3e20 2024-04-26T21:37:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.869+0000 7f3f09600640 1 -- 172.21.15.5:0/3905819785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 msgr2=0x7f3f040b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.869+0000 7f3f09600640 1 --2- 172.21.15.5:0/3905819785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 0x7f3f040b07a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009870 tx=0x7f3ef002a0f0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.870+0000 7f17e3e00640 1 -- 172.21.15.5:0/1750777904 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f17dc05ae40 con 0x7f17ec0b69b0 2024-04-26T21:37:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.870+0000 7f3f09600640 1 -- 172.21.15.5:0/3905819785 shutdown_connections 2024-04-26T21:37:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.870+0000 7f3f09600640 1 --2- 172.21.15.5:0/3905819785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f0414bcc0 0x7f3f0414c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.870+0000 7f3f09600640 1 --2- 172.21.15.5:0/3905819785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 0x7f3f040b07a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.870+0000 7f3f09600640 1 -- 172.21.15.5:0/3905819785 >> 172.21.15.5:0/3905819785 conn(0x7f3f0406c720 msgr2=0x7f3f0406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.870+0000 7f3f09600640 1 -- 172.21.15.5:0/3905819785 shutdown_connections 2024-04-26T21:37:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.870+0000 7f13de000640 1 -- 172.21.15.5:0/2770468043 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4017070 con 0x7f13e00c09e0 2024-04-26T21:37:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.871+0000 7f13de000640 1 -- 172.21.15.5:0/2770468043 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d400c940 con 0x7f13e00c09e0 2024-04-26T21:37:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.871+0000 7f13de000640 1 -- 172.21.15.5:0/2770468043 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4009e60 con 0x7f13e00c09e0 2024-04-26T21:37:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.871+0000 7f14df400640 1 -- 172.21.15.5:0/2235299757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14e000bc20 con 0x7f14e80b3e20 2024-04-26T21:37:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.871+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e0009470 con 0x7f13e00c09e0 2024-04-26T21:37:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.872+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e00ccd00 con 0x7f13e00c09e0 2024-04-26T21:37:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.874+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e00099a0 con 0x7f13e00c09e0 2024-04-26T21:37:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.872+0000 7f3f09600640 1 -- 172.21.15.5:0/3905819785 wait complete. 2024-04-26T21:37:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.875+0000 7f3f09600640 1 Processor -- start 2024-04-26T21:37:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.875+0000 7f3f09600640 1 -- start start 2024-04-26T21:37:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.872+0000 7f14df400640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c806c970 0x7f14c806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.872+0000 7f14df400640 1 -- 172.21.15.5:0/2235299757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f14e008c310 con 0x7f14e80b3e20 2024-04-26T21:37:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.874+0000 7f14e6000640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c806c970 0x7f14c806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.875+0000 7f14e6000640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c806c970 0x7f14c806ee30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14e80b0630 tx=0x7f14d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.876+0000 7ff25aa00640 1 -- 172.21.15.5:0/1821215069 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff2500b4020 con 0x7ff26414c070 2024-04-26T21:37:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.876+0000 7f3f09600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 0x7f3f0413c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.876+0000 7f3f09600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f04148dd0 0x7f3f04070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.876+0000 7f3f09600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0414bcc0 0x7f3f041e5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f3f09600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f04153170 con 0x7f3f0414bcc0 2024-04-26T21:37:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f3f09600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3f04152ff0 con 0x7f3f040b6d50 2024-04-26T21:37:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f3f09600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3f041532f0 con 0x7f3f04148dd0 2024-04-26T21:37:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f3f03400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0414bcc0 0x7f3f041e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f13de000640 1 -- 172.21.15.5:0/2770468043 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13d401a070 con 0x7f13e00c09e0 2024-04-26T21:37:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f3f02000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f04148dd0 0x7f3f04070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f3f02000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f04148dd0 0x7f3f04070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49132/0 (socket says 172.21.15.5:49132) 2024-04-26T21:37:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.877+0000 7f3f02000640 1 -- 172.21.15.5:0/906463259 learned_addr learned my addr 172.21.15.5:0/906463259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.878+0000 7f3f03400640 1 -- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f04148dd0 msgr2=0x7f3f04070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.878+0000 7f3f03400640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f04148dd0 0x7f3f04070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.878+0000 7f3f03400640 1 -- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 msgr2=0x7f3f0413c720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:37:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.878+0000 7f3f03400640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 0x7f3f0413c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.878+0000 7f3f03400640 1 -- 172.21.15.5:0/906463259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f040715b0 con 0x7f3f0414bcc0 2024-04-26T21:37:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.879+0000 7f13de000640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f13c806c8f0 0x7f13c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.879+0000 7f13de000640 1 -- 172.21.15.5:0/2770468043 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f13d40577b0 con 0x7f13e00c09e0 2024-04-26T21:37:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.879+0000 7f3f03400640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0414bcc0 0x7f3f041e5950 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c7b0 tx=0x7f3efc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.880+0000 7f13e5e00640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f13c806c8f0 0x7f13c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.881+0000 7f13e5e00640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f13c806c8f0 0x7f13c806edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f13d8037000 tx=0x7f13d8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.885+0000 7f14df400640 1 -- 172.21.15.5:0/2235299757 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f14e814ccd0 con 0x7f14e80b3e20 2024-04-26T21:37:43.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.886+0000 7f3efaa00640 1 -- 172.21.15.5:0/906463259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc017070 con 0x7f3f0414bcc0 2024-04-26T21:37:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.886+0000 7f3efaa00640 1 -- 172.21.15.5:0/906463259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc003b70 con 0x7f3f0414bcc0 2024-04-26T21:37:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.886+0000 7f3efaa00640 1 -- 172.21.15.5:0/906463259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc005070 con 0x7f3f0414bcc0 2024-04-26T21:37:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.886+0000 7f3f09600640 1 -- 172.21.15.5:0/906463259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0413b900 con 0x7f3f0414bcc0 2024-04-26T21:37:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.887+0000 7f3f09600640 1 -- 172.21.15.5:0/906463259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f040704d0 con 0x7f3f0414bcc0 2024-04-26T21:37:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.889+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed8005290 con 0x7f3f0414bcc0 2024-04-26T21:37:43.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.898+0000 7f13de000640 1 -- 172.21.15.5:0/2770468043 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f13d4059710 con 0x7f13e00c09e0 2024-04-26T21:37:43.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.898+0000 7f3efaa00640 1 -- 172.21.15.5:0/906463259 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3efc01a070 con 0x7f3f0414bcc0 2024-04-26T21:37:43.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.900+0000 7f3efaa00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3ee406c9f0 0x7f3ee406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.901+0000 7f3efaa00640 1 -- 172.21.15.5:0/906463259 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3efc08b820 con 0x7f3f0414bcc0 2024-04-26T21:37:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.905+0000 7f3f02a00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3ee406c9f0 0x7f3ee406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.905+0000 7f3efaa00640 1 -- 172.21.15.5:0/906463259 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3efc021020 con 0x7f3f0414bcc0 2024-04-26T21:37:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.907+0000 7f3f02a00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3ee406c9f0 0x7f3ee406eeb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0034000 tx=0x7f3ef002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.913+0000 7fc8fae00640 1 Processor -- start 2024-04-26T21:37:43.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.913+0000 7fc8fae00640 1 -- start start 2024-04-26T21:37:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.915+0000 7fc8fae00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f4142a20 0x7fc8f40b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.915+0000 7fc8fae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f40bb260 con 0x7fc8f40bae80 2024-04-26T21:37:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.915+0000 7fc8fae00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f40b6270 con 0x7fc8f4148600 2024-04-26T21:37:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.915+0000 7fc8fae00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f40b6550 con 0x7fc8f4142a20 2024-04-26T21:37:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.916+0000 7fc8f9000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f4142a20 0x7fc8f40b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.916+0000 7fc8fa400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc8f4148600 0x7fc8f4148a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:50800/0 (socket says 172.21.15.5:50800) 2024-04-26T21:37:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.916+0000 7fc8fa400640 1 -- 172.21.15.5:0/586518955 learned_addr learned my addr 172.21.15.5:0/586518955 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.916+0000 7fc8f9000640 1 -- 172.21.15.5:0/586518955 >> v1:172.21.15.112:6789/0 conn(0x7fc8f4148600 legacy=0x7fc8f4148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.916+0000 7fc8f9000640 1 -- 172.21.15.5:0/586518955 >> v1:172.21.15.5:6789/0 conn(0x7fc8f40bae80 legacy=0x7fc8f4142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.916+0000 7fc8f9000640 1 -- 172.21.15.5:0/586518955 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f40b6830 con 0x7fc8f4142a20 2024-04-26T21:37:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.919+0000 7fc8f9000640 1 --2- 172.21.15.5:0/586518955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f4142a20 0x7fc8f40b57d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00097d0 tx=0x7fc8e002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=781cb09666a9d274 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.922+0000 7fc8f3e00640 1 -- 172.21.15.5:0/586518955 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0037070 con 0x7fc8f4142a20 2024-04-26T21:37:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.922+0000 7fc8f3e00640 1 -- 172.21.15.5:0/586518955 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e002ae40 con 0x7fc8f4142a20 2024-04-26T21:37:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.922+0000 7fc8f3e00640 1 -- 172.21.15.5:0/586518955 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0032660 con 0x7fc8f4142a20 2024-04-26T21:37:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.923+0000 7fc8fae00640 1 -- 172.21.15.5:0/586518955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f4142a20 msgr2=0x7fc8f40b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.923+0000 7fc8fae00640 1 --2- 172.21.15.5:0/586518955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f4142a20 0x7fc8f40b57d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00097d0 tx=0x7fc8e002a130 comp rx=0 tx=0).stop 2024-04-26T21:37:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.925+0000 7fc8fae00640 1 -- 172.21.15.5:0/586518955 shutdown_connections 2024-04-26T21:37:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.925+0000 7fc8fae00640 1 --2- 172.21.15.5:0/586518955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f4142a20 0x7fc8f40b57d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.925+0000 7fc8fae00640 1 -- 172.21.15.5:0/586518955 >> 172.21.15.5:0/586518955 conn(0x7fc8f40684b0 msgr2=0x7fc8f40688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.925+0000 7fc8fae00640 1 -- 172.21.15.5:0/586518955 shutdown_connections 2024-04-26T21:37:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.925+0000 7fc8fae00640 1 -- 172.21.15.5:0/586518955 wait complete. 2024-04-26T21:37:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.927+0000 7fc8fae00640 1 Processor -- start 2024-04-26T21:37:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.928+0000 7fc8fae00640 1 -- start start 2024-04-26T21:37:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.929+0000 7fc8fae00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f40bae80 0x7fc8f414bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.929+0000 7fc8fae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4142a20 0x7fc8f413b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.930+0000 7fc8f9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f40bae80 0x7fc8f414bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.930+0000 7fc8f9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f40bae80 0x7fc8f414bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49144/0 (socket says 172.21.15.5:49144) 2024-04-26T21:37:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.930+0000 7fc8fae00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f4148600 0x7fc8f4139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.930+0000 7fc8f9a00640 1 -- 172.21.15.5:0/307949170 learned_addr learned my addr 172.21.15.5:0/307949170 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.930+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4153fa0 con 0x7fc8f4142a20 2024-04-26T21:37:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.930+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4153e20 con 0x7fc8f4148600 2024-04-26T21:37:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.930+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f4154120 con 0x7fc8f40bae80 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.931+0000 7fc8fa400640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f4148600 0x7fc8f4139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.932+0000 7fc8f9a00640 1 -- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f4148600 msgr2=0x7fc8f4139ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.932+0000 7fc8f9a00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f4148600 0x7fc8f4139ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.932+0000 7fc8f9a00640 1 -- 172.21.15.5:0/307949170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4142a20 msgr2=0x7fc8f413b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.932+0000 7fc8f9a00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4142a20 0x7fc8f413b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.932+0000 7fc8f9a00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f413cee0 con 0x7fc8f40bae80 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.934+0000 7fc8f9a00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f40bae80 0x7fc8f414bc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800c440 tx=0x7fc8e800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.935+0000 7fc8f1600640 1 -- 172.21.15.5:0/307949170 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8017070 con 0x7fc8f40bae80 2024-04-26T21:37:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.935+0000 7fc8f1600640 1 -- 172.21.15.5:0/307949170 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e80035f0 con 0x7fc8f40bae80 2024-04-26T21:37:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.935+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f414c6b0 con 0x7fc8f40bae80 2024-04-26T21:37:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.935+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f413d150 con 0x7fc8f40bae80 2024-04-26T21:37:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.937+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d0005290 con 0x7fc8f40bae80 2024-04-26T21:37:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.941+0000 7fc8f1600640 1 -- 172.21.15.5:0/307949170 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80039e0 con 0x7fc8f40bae80 2024-04-26T21:37:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.943+0000 7fc8f1600640 1 -- 172.21.15.5:0/307949170 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8e8003b80 con 0x7fc8f40bae80 2024-04-26T21:37:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.945+0000 7fc8f1600640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8d406c8f0 0x7fc8d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.945+0000 7fc8f1600640 1 -- 172.21.15.5:0/307949170 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc8e808b150 con 0x7fc8f40bae80 2024-04-26T21:37:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.946+0000 7fc8f9000640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8d406c8f0 0x7fc8d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.947+0000 7fc8f9000640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8d406c8f0 0x7fc8d406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0034000 tx=0x7fc8e002c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.952+0000 7fadd3e00640 1 Processor -- start 2024-04-26T21:37:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.952+0000 7fadd3e00640 1 -- start start 2024-04-26T21:37:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.954+0000 7fadd3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1930 0x7fadcc0739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.955+0000 7fadd3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fadcc144df0 0x7fadcc14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.955+0000 7fadd3e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc0b2690 con 0x7fadcc0b1d10 2024-04-26T21:37:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.955+0000 7fadd1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1930 0x7fadcc0739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.955+0000 7fadd1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1930 0x7fadcc0739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:49160/0 (socket says 172.21.15.5:49160) 2024-04-26T21:37:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.955+0000 7fadd1400640 1 -- 172.21.15.5:0/1440577459 learned_addr learned my addr 172.21.15.5:0/1440577459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.955+0000 7fadd3e00640 1 -- 172.21.15.5:0/1440577459 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fadcc0b3ba0 con 0x7fadcc144df0 2024-04-26T21:37:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.956+0000 7fadd1e00640 1 --2- 172.21.15.5:0/1440577459 >> v2:172.21.15.112:3300/0 conn(0x7fadcc144df0 0x7fadcc14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.956+0000 7fadd3e00640 1 -- 172.21.15.5:0/1440577459 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc0b2970 con 0x7fadcc0b1930 2024-04-26T21:37:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.957+0000 7fadcbe00640 1 -- 172.21.15.5:0/1440577459 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588086139 0 0) 0x7fadcc0b2690 con 0x7fadcc0b1d10 2024-04-26T21:37:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.957+0000 7fadcbe00640 1 -- 172.21.15.5:0/1440577459 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb4003520 con 0x7fadcc0b1d10 2024-04-26T21:37:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.957+0000 7fadd1400640 1 -- 172.21.15.5:0/1440577459 >> v2:172.21.15.112:3300/0 conn(0x7fadcc144df0 msgr2=0x7fadcc14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.957+0000 7fadd1400640 1 --2- 172.21.15.5:0/1440577459 >> v2:172.21.15.112:3300/0 conn(0x7fadcc144df0 0x7fadcc14ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.957+0000 7fadd1400640 1 -- 172.21.15.5:0/1440577459 >> v1:172.21.15.112:6789/0 conn(0x7fadcc0b1d10 legacy=0x7fadcc1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.957+0000 7fadd1400640 1 -- 172.21.15.5:0/1440577459 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0b1650 con 0x7fadcc0b1930 2024-04-26T21:37:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.959+0000 7fadd1400640 1 --2- 172.21.15.5:0/1440577459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1930 0x7fadcc0739e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009870 tx=0x7fadc002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a3e0a6eb582e3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.960+0000 7fc8f1600640 1 -- 172.21.15.5:0/307949170 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc8e80010c0 con 0x7fc8f40bae80 2024-04-26T21:37:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.960+0000 7fadcbe00640 1 -- 172.21.15.5:0/1440577459 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0037070 con 0x7fadcc0b1930 2024-04-26T21:37:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.960+0000 7fadcbe00640 1 -- 172.21.15.5:0/1440577459 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc002ae00 con 0x7fadcc0b1930 2024-04-26T21:37:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.960+0000 7fadcbe00640 1 -- 172.21.15.5:0/1440577459 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0032660 con 0x7fadcc0b1930 2024-04-26T21:37:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.961+0000 7fadd3e00640 1 -- 172.21.15.5:0/1440577459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1930 msgr2=0x7fadcc0739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.961+0000 7fadd3e00640 1 --2- 172.21.15.5:0/1440577459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1930 0x7fadcc0739e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009870 tx=0x7fadc002a0f0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.964+0000 7fadd3e00640 1 -- 172.21.15.5:0/1440577459 shutdown_connections 2024-04-26T21:37:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.964+0000 7fadd3e00640 1 --2- 172.21.15.5:0/1440577459 >> v2:172.21.15.112:3300/0 conn(0x7fadcc144df0 0x7fadcc14ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.964+0000 7fadd3e00640 1 --2- 172.21.15.5:0/1440577459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1930 0x7fadcc0739e0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009870 tx=0x7fadc002a0f0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.964+0000 7fadd3e00640 1 -- 172.21.15.5:0/1440577459 >> 172.21.15.5:0/1440577459 conn(0x7fadcc0b9bc0 msgr2=0x7fadcc0b9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.964+0000 7fadd3e00640 1 -- 172.21.15.5:0/1440577459 shutdown_connections 2024-04-26T21:37:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.964+0000 7fadd3e00640 1 -- 172.21.15.5:0/1440577459 wait complete. 2024-04-26T21:37:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.967+0000 7fadd3e00640 1 Processor -- start 2024-04-26T21:37:43.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.968+0000 7fadd3e00640 1 -- start start 2024-04-26T21:37:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.973+0000 7fadd3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1d10 0x7fadcc141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.974+0000 7fadd3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc13fa00 0x7fadcc13fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.974+0000 7fadd0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc13fa00 0x7fadcc13fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.974+0000 7fadd3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc13c420 0x7fadcc13c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.975+0000 7fadd3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0b3980 con 0x7fadcc13fa00 2024-04-26T21:37:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.975+0000 7fadd1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1d10 0x7fadcc141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.975+0000 7fadd1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc13c420 0x7fadcc13c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.975+0000 7fadd1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc13c420 0x7fadcc13c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54106/0 (socket says 172.21.15.5:54106) 2024-04-26T21:37:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.976+0000 7fadd1e00640 1 -- 172.21.15.5:0/1070615193 learned_addr learned my addr 172.21.15.5:0/1070615193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.976+0000 7fadd3e00640 1 -- 172.21.15.5:0/1070615193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0b3800 con 0x7fadcc13c420 2024-04-26T21:37:43.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.976+0000 7fadd3e00640 1 -- 172.21.15.5:0/1070615193 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc073f20 con 0x7fadcc0b1d10 2024-04-26T21:37:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.977+0000 7fadd0a00640 1 -- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1d10 msgr2=0x7fadcc141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.977+0000 7fadd0a00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1d10 0x7fadcc141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.977+0000 7fadd0a00640 1 -- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc13c420 msgr2=0x7fadcc13c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.977+0000 7fadd0a00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc13c420 0x7fadcc13c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:43.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.977+0000 7fadd0a00640 1 -- 172.21.15.5:0/1070615193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc140f50 con 0x7fadcc13fa00 2024-04-26T21:37:43.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.982+0000 7fadd0a00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc13fa00 0x7fadcc13fe80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c440 tx=0x7fadbc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:43.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.982+0000 7fadc9600640 1 -- 172.21.15.5:0/1070615193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc017070 con 0x7fadcc13fa00 2024-04-26T21:37:43.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.983+0000 7fadd3e00640 1 -- 172.21.15.5:0/1070615193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1414a0 con 0x7fadcc13fa00 2024-04-26T21:37:43.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.983+0000 7fadd3e00640 1 -- 172.21.15.5:0/1070615193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1485e0 con 0x7fadcc13fa00 2024-04-26T21:37:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.986+0000 7fadc9600640 1 -- 172.21.15.5:0/1070615193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc0035f0 con 0x7fadcc13fa00 2024-04-26T21:37:43.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.986+0000 7fadc9600640 1 -- 172.21.15.5:0/1070615193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0039e0 con 0x7fadcc13fa00 2024-04-26T21:37:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:43.987+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada8005290 con 0x7fadcc13fa00 2024-04-26T21:37:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.004+0000 7fadc9600640 1 -- 172.21.15.5:0/1070615193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fadbc01a070 con 0x7fadcc13fa00 2024-04-26T21:37:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.014+0000 7fadc9600640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadb006c920 0x7fadb006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:44.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.015+0000 7fadd1400640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadb006c920 0x7fadb006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.019+0000 7fadc9600640 1 -- 172.21.15.5:0/1070615193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fadbc08adf0 con 0x7fadcc13fa00 2024-04-26T21:37:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.019+0000 7fadc9600640 1 -- 172.21.15.5:0/1070615193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fadbc058890 con 0x7fadcc13fa00 2024-04-26T21:37:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.020+0000 7fadd1400640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadb006c920 0x7fadb006ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fadc0034000 tx=0x7fadc002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.319+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc42413f920 con 0x7fc4240b2b10 2024-04-26T21:37:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.319+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f14e8075db0 con 0x7f14e80b3e20 2024-04-26T21:37:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.321+0000 7f14df400640 1 -- 172.21.15.5:0/2235299757 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14e005a3e0 con 0x7f14e80b3e20 2024-04-26T21:37:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.321+0000 7fc41be00640 1 -- 172.21.15.5:0/4144516579 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc410059890 con 0x7fc4240b2b10 2024-04-26T21:37:44.321 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-04-26T21:37:44.321 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-04-26T21:37:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.324+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc40406cb40 msgr2=0x7fc40406f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.324+0000 7fc42b000640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc40406cb40 0x7fc40406f000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc414037000 tx=0x7fc414032000 comp rx=0 tx=0).stop 2024-04-26T21:37:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.324+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4240b2b10 msgr2=0x7fc42413c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.324+0000 7fc42b000640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4240b2b10 0x7fc42413c0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4240b2f10 tx=0x7fc410001e70 comp rx=0 tx=0).stop 2024-04-26T21:37:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.325+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c806c970 msgr2=0x7f14c806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.325+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 shutdown_connections 2024-04-26T21:37:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.325+0000 7f14ede00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c806c970 0x7f14c806ee30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14e80b0630 tx=0x7f14d4009040 comp rx=0 tx=0).stop 2024-04-26T21:37:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.325+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e80b3e20 msgr2=0x7f14e8149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.325+0000 7f14ede00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e80b3e20 0x7f14e8149e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14e000d800 tx=0x7f14e000dcc0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7fc42b000640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4241452e0 0x7fc4241e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7fc42b000640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc40406cb40 0x7fc40406f000 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7fc42b000640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4240b2b10 0x7fc42413c0d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7fc42b000640 1 --2- 172.21.15.5:0/4144516579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc4240b08e0 0x7fc42413d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 shutdown_connections 2024-04-26T21:37:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 >> 172.21.15.5:0/4144516579 conn(0x7fc42406c4e0 msgr2=0x7fc4241cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7f14ede00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e8146f90 0x7f14e8148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7f14ede00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e80b6d50 0x7f14e8147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 shutdown_connections 2024-04-26T21:37:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7fc42b000640 1 -- 172.21.15.5:0/4144516579 wait complete. 2024-04-26T21:37:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7f14ede00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f14c806c970 0x7f14c806ee30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7f14ede00640 1 --2- 172.21.15.5:0/2235299757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14e80b3e20 0x7f14e8149e10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 >> 172.21.15.5:0/2235299757 conn(0x7f14e806c720 msgr2=0x7f14e814c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.326+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 shutdown_connections 2024-04-26T21:37:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.327+0000 7f14ede00640 1 -- 172.21.15.5:0/2235299757 wait complete. 2024-04-26T21:37:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.337+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f17ec147e60 con 0x7f17ec0b69b0 2024-04-26T21:37:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.338+0000 7f17e3e00640 1 -- 172.21.15.5:0/1750777904 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17dc05a740 con 0x7f17ec0b69b0 2024-04-26T21:37:44.339 INFO:teuthology.orchestra.run.smithi005.stdout:55834574859 2024-04-26T21:37:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.340+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f13e00cb5d0 con 0x7f13e00c09e0 2024-04-26T21:37:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.341+0000 7f13de000640 1 -- 172.21.15.5:0/2770468043 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13d405da10 con 0x7f13e00c09e0 2024-04-26T21:37:44.342 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-04-26T21:37:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.342+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17cc06c940 msgr2=0x7f17cc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.342+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff264141890 con 0x7ff26414c070 2024-04-26T21:37:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.342+0000 7f17f1400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17cc06c940 0x7f17cc06ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17ec073a00 tx=0x7f17d8009040 comp rx=0 tx=0).stop 2024-04-26T21:37:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.342+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17ec0b69b0 msgr2=0x7f17ec144d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.342+0000 7f17f1400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17ec0b69b0 0x7f17ec144d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d5f0 tx=0x7f17dc00dab0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 shutdown_connections 2024-04-26T21:37:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f17cc06c940 0x7f17cc06ee00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ec1421a0 0x7f17ec1e2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17ec0b87d0 0x7f17ec1e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 --2- 172.21.15.5:0/1750777904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17ec0b69b0 0x7f17ec144d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 >> 172.21.15.5:0/1750777904 conn(0x7f17ec0bde50 msgr2=0x7f17ec13f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 shutdown_connections 2024-04-26T21:37:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7ff25aa00640 1 -- 172.21.15.5:0/1821215069 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff250062e20 con 0x7ff26414c070 2024-04-26T21:37:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.343+0000 7f17f1400640 1 -- 172.21.15.5:0/1750777904 wait complete. 2024-04-26T21:37:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.345+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f13c806c8f0 msgr2=0x7f13c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.345+0000 7f13e7200640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f13c806c8f0 0x7f13c806edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f13d8037000 tx=0x7f13d8032000 comp rx=0 tx=0).stop 2024-04-26T21:37:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.345+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e00c09e0 msgr2=0x7f13e00cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.345+0000 7f13e7200640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e00c09e0 0x7f13e00cd490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13d400e8a0 tx=0x7f13d400ed60 comp rx=0 tx=0).stop 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.345+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 shutdown_connections 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.346+0000 7f13e7200640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13e00caab0 0x7f13e015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.346+0000 7f13e7200640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13e00c09e0 0x7f13e00cd490 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.346+0000 7f13e7200640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f13c806c8f0 0x7f13c806edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.346+0000 7f13e7200640 1 --2- 172.21.15.5:0/2770468043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e0038cb0 0x7f13e00cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.346+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 >> 172.21.15.5:0/2770468043 conn(0x7f13e003cab0 msgr2=0x7f13e003b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.346+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 shutdown_connections 2024-04-26T21:37:44.347 INFO:teuthology.orchestra.run.smithi005.stdout:55834574859 2024-04-26T21:37:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.346+0000 7f13e7200640 1 -- 172.21.15.5:0/2770468043 wait complete. 2024-04-26T21:37:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff24406c8f0 msgr2=0x7ff24406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff24406c8f0 0x7ff24406edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00e190 tx=0x7ff25c00b040 comp rx=0 tx=0).stop 2024-04-26T21:37:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 msgr2=0x7ff2641ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641ee4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff250009870 tx=0x7ff2500046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 shutdown_connections 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26414c070 0x7ff2641ee4a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640badf0 0x7ff2641e48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff24406c8f0 0x7ff24406edb0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00e190 tx=0x7ff25c00b040 comp rx=0 tx=0).stop 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 --2- 172.21.15.5:0/1821215069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640b5760 0x7ff264148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.347+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 >> 172.21.15.5:0/1821215069 conn(0x7ff2640684b0 msgr2=0x7ff2640bd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.348+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 shutdown_connections 2024-04-26T21:37:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.348+0000 7ff268a00640 1 -- 172.21.15.5:0/1821215069 wait complete. 2024-04-26T21:37:44.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-04-26T21:37:44.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-04-26T21:37:44.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-26T21:37:44.372 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:44.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-26T21:37:44.373 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:44.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-26T21:37:44.375 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.386+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3ed8005850 con 0x7f3f0414bcc0 2024-04-26T21:37:44.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.386+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc8d0005580 con 0x7fc8f40bae80 2024-04-26T21:37:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.387+0000 7f3efaa00640 1 -- 172.21.15.5:0/906463259 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3efc059330 con 0x7f3f0414bcc0 2024-04-26T21:37:44.387 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-04-26T21:37:44.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.387+0000 7fc8f1600640 1 -- 172.21.15.5:0/307949170 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8e8058b60 con 0x7fc8f40bae80 2024-04-26T21:37:44.388 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-04-26T21:37:44.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3ee406c9f0 msgr2=0x7f3ee406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3ee406c9f0 0x7f3ee406eeb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0034000 tx=0x7f3ef002e000 comp rx=0 tx=0).stop 2024-04-26T21:37:44.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0414bcc0 msgr2=0x7f3f041e5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0414bcc0 0x7f3f041e5950 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c7b0 tx=0x7f3efc00cc70 comp rx=0 tx=0).stop 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 shutdown_connections 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3ee406c9f0 0x7f3ee406eeb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0414bcc0 0x7f3f041e5950 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f04148dd0 0x7f3f04070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 --2- 172.21.15.5:0/906463259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f040b6d50 0x7f3f0413c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 >> 172.21.15.5:0/906463259 conn(0x7f3f0406c720 msgr2=0x7f3f040b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8d406c8f0 msgr2=0x7fc8d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8d406c8f0 0x7fc8d406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0034000 tx=0x7fc8e002c000 comp rx=0 tx=0).stop 2024-04-26T21:37:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f40bae80 msgr2=0x7fc8f414bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f40bae80 0x7fc8f414bc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800c440 tx=0x7fc8e800c900 comp rx=0 tx=0).stop 2024-04-26T21:37:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 shutdown_connections 2024-04-26T21:37:44.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7f3eefe00640 1 -- 172.21.15.5:0/906463259 wait complete. 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 shutdown_connections 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f4148600 0x7fc8f4139ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8d406c8f0 0x7fc8d406edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f4142a20 0x7fc8f413b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 --2- 172.21.15.5:0/307949170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f40bae80 0x7fc8f414bc00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.389+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 >> 172.21.15.5:0/307949170 conn(0x7fc8f40684b0 msgr2=0x7fc8f41420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.390+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 shutdown_connections 2024-04-26T21:37:44.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.390+0000 7fc8fae00640 1 -- 172.21.15.5:0/307949170 wait complete. 2024-04-26T21:37:44.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-04-26T21:37:44.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-26T21:37:44.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.439+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fada8005850 con 0x7fadcc13fa00 2024-04-26T21:37:44.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.440+0000 7fadc9600640 1 -- 172.21.15.5:0/1070615193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fadbc05cb90 con 0x7fadcc13fa00 2024-04-26T21:37:44.440 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadb006c920 msgr2=0x7fadb006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadb006c920 0x7fadb006ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fadc0034000 tx=0x7fadc002e000 comp rx=0 tx=0).stop 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc13fa00 msgr2=0x7fadcc13fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc13fa00 0x7fadcc13fe80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c440 tx=0x7fadbc00c900 comp rx=0 tx=0).stop 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 shutdown_connections 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadcc13c420 0x7fadcc13c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fadb006c920 0x7fadb006ede0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc13fa00 0x7fadcc13fe80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 --2- 172.21.15.5:0/1070615193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fadcc0b1d10 0x7fadcc141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:44.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.442+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 >> 172.21.15.5:0/1070615193 conn(0x7fadcc0b9bc0 msgr2=0x7fadcc0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:44.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.443+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 shutdown_connections 2024-04-26T21:37:44.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:44.443+0000 7fadbaa00640 1 -- 172.21.15.5:0/1070615193 wait complete. 2024-04-26T21:37:44.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-04-26T21:37:45.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T21:37:45.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T21:37:45.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T21:37:45.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T21:37:45.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T21:37:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.556+0000 7f6e40c00640 1 Processor -- start 2024-04-26T21:37:45.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.556+0000 7f6e40c00640 1 -- start start 2024-04-26T21:37:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.558+0000 7f6e40c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e3c148d10 0x7f6e3c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.558+0000 7f6e40c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0bb260 con 0x7f6e3c142a20 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.558+0000 7f6e40c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0b6270 con 0x7f6e3c0bae80 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.558+0000 7f6e40c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c0b6550 con 0x7f6e3c148d10 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.559+0000 7f6e3be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e3c148d10 0x7f6e3c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.559+0000 7f6e3b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6e3c0bae80 0x7f6e3c142310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:34986/0 (socket says 172.21.15.5:34986) 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.559+0000 7f6e3b400640 1 -- 172.21.15.5:0/2521444885 learned_addr learned my addr 172.21.15.5:0/2521444885 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.559+0000 7f6e3be00640 1 -- 172.21.15.5:0/2521444885 >> v1:172.21.15.112:6789/0 conn(0x7f6e3c0bae80 legacy=0x7f6e3c142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.559+0000 7f6e3be00640 1 -- 172.21.15.5:0/2521444885 >> v1:172.21.15.5:6789/0 conn(0x7f6e3c142a20 legacy=0x7f6e3c148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.559+0000 7f6e3be00640 1 -- 172.21.15.5:0/2521444885 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c0b6830 con 0x7f6e3c148d10 2024-04-26T21:37:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.561+0000 7f6e3be00640 1 --2- 172.21.15.5:0/2521444885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c148d10 0x7f6e3c0b57d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d90 tx=0x7f6e3402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68c0cd0cf0d1dcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.561+0000 7f6e3a000640 1 -- 172.21.15.5:0/2521444885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34007740 con 0x7f6e3c148d10 2024-04-26T21:37:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.561+0000 7f6e3a000640 1 -- 172.21.15.5:0/2521444885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e340078e0 con 0x7f6e3c148d10 2024-04-26T21:37:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.561+0000 7f6e3a000640 1 -- 172.21.15.5:0/2521444885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34007cb0 con 0x7f6e3c148d10 2024-04-26T21:37:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.562+0000 7f6e40c00640 1 -- 172.21.15.5:0/2521444885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c148d10 msgr2=0x7f6e3c0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.562+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2521444885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c148d10 0x7f6e3c0b57d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d90 tx=0x7f6e3402a660 comp rx=0 tx=0).stop 2024-04-26T21:37:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.562+0000 7f6e40c00640 1 -- 172.21.15.5:0/2521444885 shutdown_connections 2024-04-26T21:37:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.562+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2521444885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c148d10 0x7f6e3c0b57d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.562+0000 7f6e40c00640 1 -- 172.21.15.5:0/2521444885 >> 172.21.15.5:0/2521444885 conn(0x7f6e3c0684b0 msgr2=0x7f6e3c0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.563+0000 7f6e40c00640 1 -- 172.21.15.5:0/2521444885 shutdown_connections 2024-04-26T21:37:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.563+0000 7f6e40c00640 1 -- 172.21.15.5:0/2521444885 wait complete. 2024-04-26T21:37:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.564+0000 7f6e40c00640 1 Processor -- start 2024-04-26T21:37:45.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.564+0000 7f6e40c00640 1 -- start start 2024-04-26T21:37:45.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.565+0000 7f6e40c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c0bae80 0x7f6e3c14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.565+0000 7f6e40c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c142a20 0x7f6e3c14b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.566+0000 7f6e40c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c148d10 0x7f6e3c1e5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.566+0000 7f6e40c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c153fa0 con 0x7f6e3c0bae80 2024-04-26T21:37:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.566+0000 7f6e40c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c153e20 con 0x7f6e3c142a20 2024-04-26T21:37:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.566+0000 7f6e40c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c154120 con 0x7f6e3c148d10 2024-04-26T21:37:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.566+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c0bae80 0x7f6e3c14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.566+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c0bae80 0x7f6e3c14a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43796/0 (socket says 172.21.15.5:43796) 2024-04-26T21:37:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.566+0000 7f6e3b400640 1 -- 172.21.15.5:0/2563690834 learned_addr learned my addr 172.21.15.5:0/2563690834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.567+0000 7f6e3aa00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c142a20 0x7f6e3c14b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.567+0000 7f6e3be00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c148d10 0x7f6e3c1e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.567+0000 7f6e3b400640 1 -- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c148d10 msgr2=0x7f6e3c1e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.567+0000 7f6e3b400640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c148d10 0x7f6e3c1e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.567+0000 7f6e3b400640 1 -- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c142a20 msgr2=0x7f6e3c14b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.567+0000 7f6e3b400640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c142a20 0x7f6e3c14b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.567+0000 7f6e3b400640 1 -- 172.21.15.5:0/2563690834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c14ae50 con 0x7f6e3c0bae80 2024-04-26T21:37:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.568+0000 7f6e3b400640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c0bae80 0x7f6e3c14a910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c4a0 tx=0x7f6e2c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.568+0000 7f6e33400640 1 -- 172.21.15.5:0/2563690834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c017070 con 0x7f6e3c0bae80 2024-04-26T21:37:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.568+0000 7f6e33400640 1 -- 172.21.15.5:0/2563690834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c005ce0 con 0x7f6e3c0bae80 2024-04-26T21:37:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.568+0000 7f6e33400640 1 -- 172.21.15.5:0/2563690834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c007270 con 0x7f6e3c0bae80 2024-04-26T21:37:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.568+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c13af10 con 0x7f6e3c0bae80 2024-04-26T21:37:45.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.568+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c14a3f0 con 0x7f6e3c0bae80 2024-04-26T21:37:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.570+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c075db0 con 0x7f6e3c0bae80 2024-04-26T21:37:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.572+0000 7f6e33400640 1 -- 172.21.15.5:0/2563690834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e2c01a070 con 0x7f6e3c0bae80 2024-04-26T21:37:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.573+0000 7f6e33400640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6e1c06c940 0x7f6e1c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.573+0000 7f6e33400640 1 -- 172.21.15.5:0/2563690834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6e2c08b0a0 con 0x7f6e3c0bae80 2024-04-26T21:37:45.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.574+0000 7f6e3aa00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6e1c06c940 0x7f6e1c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.575+0000 7f6e3aa00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6e1c06c940 0x7f6e1c06ee00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c14cb40 tx=0x7f6e28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.577+0000 7f0522000640 1 Processor -- start 2024-04-26T21:37:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.578+0000 7f0522000640 1 -- start start 2024-04-26T21:37:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f0522000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f051c0b68f0 0x7f051c0b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f0522000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c14bb70 0x7f051c142460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f0522000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f051c1429a0 0x7f051c0b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f0522000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f051c0b7e80 con 0x7f051c0b68f0 2024-04-26T21:37:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f0522000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f051c0bb330 con 0x7f051c1429a0 2024-04-26T21:37:45.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f0522000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f051c0bb580 con 0x7f051c14bb70 2024-04-26T21:37:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f051b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f051c0b68f0 0x7f051c0b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f051be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f051c1429a0 0x7f051c0b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f051b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f051c0b68f0 0x7f051c0b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43802/0 (socket says 172.21.15.5:43802) 2024-04-26T21:37:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.579+0000 7f051b400640 1 -- 172.21.15.5:0/927245244 learned_addr learned my addr 172.21.15.5:0/927245244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.580+0000 7f051aa00640 1 --2- 172.21.15.5:0/927245244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c14bb70 0x7f051c142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.580+0000 7f051b400640 1 -- 172.21.15.5:0/927245244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c14bb70 msgr2=0x7f051c142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.580+0000 7f051b400640 1 --2- 172.21.15.5:0/927245244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c14bb70 0x7f051c142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.580+0000 7f051b400640 1 -- 172.21.15.5:0/927245244 >> v2:172.21.15.112:3300/0 conn(0x7f051c1429a0 msgr2=0x7f051c0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.580+0000 7f051b400640 1 --2- 172.21.15.5:0/927245244 >> v2:172.21.15.112:3300/0 conn(0x7f051c1429a0 0x7f051c0b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.580+0000 7f051b400640 1 -- 172.21.15.5:0/927245244 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c0b5e00 con 0x7f051c0b68f0 2024-04-26T21:37:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.582+0000 7f051b400640 1 --2- 172.21.15.5:0/927245244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c0b68f0 0x7f051c0b5770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f051c0bb700 tx=0x7f050c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6af25f50f45047 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.582+0000 7f051a000640 1 -- 172.21.15.5:0/927245244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c037070 con 0x7f051c0b68f0 2024-04-26T21:37:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.583+0000 7f051a000640 1 -- 172.21.15.5:0/927245244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050c032440 con 0x7f051c0b68f0 2024-04-26T21:37:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.583+0000 7f051a000640 1 -- 172.21.15.5:0/927245244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c032810 con 0x7f051c0b68f0 2024-04-26T21:37:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.583+0000 7f6e33400640 1 -- 172.21.15.5:0/2563690834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6e3c13af10 con 0x7f6e3c0bae80 2024-04-26T21:37:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.583+0000 7f0522000640 1 -- 172.21.15.5:0/927245244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c0b68f0 msgr2=0x7f051c0b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.583+0000 7f0522000640 1 --2- 172.21.15.5:0/927245244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c0b68f0 0x7f051c0b5770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f051c0bb700 tx=0x7f050c02a140 comp rx=0 tx=0).stop 2024-04-26T21:37:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.584+0000 7f0522000640 1 -- 172.21.15.5:0/927245244 shutdown_connections 2024-04-26T21:37:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.584+0000 7f0522000640 1 --2- 172.21.15.5:0/927245244 >> v2:172.21.15.112:3300/0 conn(0x7f051c1429a0 0x7f051c0b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.584+0000 7f0522000640 1 --2- 172.21.15.5:0/927245244 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c14bb70 0x7f051c142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.584+0000 7f0522000640 1 --2- 172.21.15.5:0/927245244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c0b68f0 0x7f051c0b5770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.584+0000 7f0522000640 1 -- 172.21.15.5:0/927245244 >> 172.21.15.5:0/927245244 conn(0x7f051c068480 msgr2=0x7f051c068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.584+0000 7f0522000640 1 -- 172.21.15.5:0/927245244 shutdown_connections 2024-04-26T21:37:45.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.584+0000 7f0522000640 1 -- 172.21.15.5:0/927245244 wait complete. 2024-04-26T21:37:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.586+0000 7f0522000640 1 Processor -- start 2024-04-26T21:37:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.587+0000 7f0522000640 1 -- start start 2024-04-26T21:37:45.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.588+0000 7f0522000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c0b68f0 0x7f051c0be6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.588+0000 7f0522000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c1429a0 0x7f051c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.588+0000 7f0522000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c14bb70 0x7f051c13b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.588+0000 7f0522000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f051c14bfb0 con 0x7f051c14bb70 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.588+0000 7f0522000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f051c0b52e0 con 0x7f051c1429a0 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.588+0000 7f0522000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f051c0b6cd0 con 0x7f051c0b68f0 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051b400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c0b68f0 0x7f051c0be6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c14bb70 0x7f051c13b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c14bb70 0x7f051c13b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43806/0 (socket says 172.21.15.5:43806) 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 -- 172.21.15.5:0/3892958931 learned_addr learned my addr 172.21.15.5:0/3892958931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051aa00640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c1429a0 0x7f051c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 -- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c0b68f0 msgr2=0x7f051c0be6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c0b68f0 0x7f051c0be6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 -- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c1429a0 msgr2=0x7f051c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c1429a0 0x7f051c0b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.589+0000 7f051be00640 1 -- 172.21.15.5:0/3892958931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c0bbce0 con 0x7f051c14bb70 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.590+0000 7f051be00640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c14bb70 0x7f051c13b0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f051400ef00 tx=0x7f051400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.590+0000 7f0513400640 1 -- 172.21.15.5:0/3892958931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514018020 con 0x7f051c14bb70 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.590+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c0b3d80 con 0x7f051c14bb70 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.590+0000 7f0513400640 1 -- 172.21.15.5:0/3892958931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0514014400 con 0x7f051c14bb70 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.591+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c0bd8c0 con 0x7f051c14bb70 2024-04-26T21:37:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.591+0000 7f0513400640 1 -- 172.21.15.5:0/3892958931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140147f0 con 0x7f051c14bb70 2024-04-26T21:37:45.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.593+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f4005290 con 0x7f051c14bb70 2024-04-26T21:37:45.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.594+0000 7f0513400640 1 -- 172.21.15.5:0/3892958931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f051401b020 con 0x7f051c14bb70 2024-04-26T21:37:45.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.595+0000 7f0513400640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f04fc06c920 0x7f04fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.596+0000 7f0513400640 1 -- 172.21.15.5:0/3892958931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0514090060 con 0x7f051c14bb70 2024-04-26T21:37:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.596+0000 7f051b400640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f04fc06c920 0x7f04fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.597+0000 7f051b400640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f04fc06c920 0x7f04fc06ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f050c034000 tx=0x7f050c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.604+0000 7f0513400640 1 -- 172.21.15.5:0/3892958931 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f05140593e0 con 0x7f051c14bb70 2024-04-26T21:37:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.613+0000 7fdfa0200640 1 Processor -- start 2024-04-26T21:37:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.613+0000 7fdfa0200640 1 -- start start 2024-04-26T21:37:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.614+0000 7fdfa0200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf981489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.614+0000 7fdfa0200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf9814dcd0 0x7fdf981500c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.614+0000 7fdfa0200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf98071800 con 0x7fdf98072a50 2024-04-26T21:37:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.614+0000 7fdfa0200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdf980715b0 con 0x7fdf9814dcd0 2024-04-26T21:37:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.614+0000 7fdfa0200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdf98072e30 con 0x7fdf980bb2e0 2024-04-26T21:37:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf9814dcd0 0x7fdf981500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf9814dcd0 0x7fdf981500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43820/0 (socket says 172.21.15.5:43820) 2024-04-26T21:37:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9e200640 1 -- 172.21.15.5:0/1029540411 learned_addr learned my addr 172.21.15.5:0/1029540411 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9ce00640 1 --2- 172.21.15.5:0/1029540411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf981489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9e200640 1 -- 172.21.15.5:0/1029540411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 msgr2=0x7fdf981489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9e200640 1 --2- 172.21.15.5:0/1029540411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf981489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9e200640 1 -- 172.21.15.5:0/1029540411 >> v1:172.21.15.112:6789/0 conn(0x7fdf98072a50 legacy=0x7fdf9813f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.615+0000 7fdf9e200640 1 -- 172.21.15.5:0/1029540411 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf980b1c70 con 0x7fdf9814dcd0 2024-04-26T21:37:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.616+0000 7fdf9e200640 1 --2- 172.21.15.5:0/1029540411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf981500c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000d150 tx=0x7fdf9002c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c347147fd3be28 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.617+0000 7fdf97e00640 1 -- 172.21.15.5:0/1029540411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90039070 con 0x7fdf9814dcd0 2024-04-26T21:37:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.617+0000 7fdf97e00640 1 -- 172.21.15.5:0/1029540411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf90009600 con 0x7fdf9814dcd0 2024-04-26T21:37:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.617+0000 7fdf97e00640 1 -- 172.21.15.5:0/1029540411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf900099f0 con 0x7fdf9814dcd0 2024-04-26T21:37:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.617+0000 7fdfa0200640 1 -- 172.21.15.5:0/1029540411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 msgr2=0x7fdf981500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.617+0000 7fdfa0200640 1 --2- 172.21.15.5:0/1029540411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf981500c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000d150 tx=0x7fdf9002c810 comp rx=0 tx=0).stop 2024-04-26T21:37:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7ffb6e000640 1 Processor -- start 2024-04-26T21:37:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7fdfa0200640 1 -- 172.21.15.5:0/1029540411 shutdown_connections 2024-04-26T21:37:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7fdfa0200640 1 --2- 172.21.15.5:0/1029540411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf981500c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7fdfa0200640 1 --2- 172.21.15.5:0/1029540411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf981489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7fdfa0200640 1 -- 172.21.15.5:0/1029540411 >> 172.21.15.5:0/1029540411 conn(0x7fdf9806d5f0 msgr2=0x7fdf9806da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7ffb6e000640 1 -- start start 2024-04-26T21:37:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7fdfa0200640 1 -- 172.21.15.5:0/1029540411 shutdown_connections 2024-04-26T21:37:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.618+0000 7fdfa0200640 1 -- 172.21.15.5:0/1029540411 wait complete. 2024-04-26T21:37:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.619+0000 7ffb6e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb680bae80 0x7ffb680b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.619+0000 7ffb6e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffb68148d10 0x7ffb681427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.619+0000 7ffb6e000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb680bb260 con 0x7ffb68142310 2024-04-26T21:37:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.619+0000 7ffb6e000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffb680b6270 con 0x7ffb680bae80 2024-04-26T21:37:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.619+0000 7ffb6e000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ffb680b6550 con 0x7ffb68148d10 2024-04-26T21:37:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb680bae80 0x7ffb680b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7fdfa0200640 1 Processor -- start 2024-04-26T21:37:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb680bae80 0x7ffb680b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43824/0 (socket says 172.21.15.5:43824) 2024-04-26T21:37:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6cc00640 1 -- 172.21.15.5:0/3192092790 learned_addr learned my addr 172.21.15.5:0/3192092790 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7fdfa0200640 1 -- start start 2024-04-26T21:37:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6d600640 1 --2- 172.21.15.5:0/3192092790 >> v2:172.21.15.112:3300/0 conn(0x7ffb68148d10 0x7ffb681427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6cc00640 1 -- 172.21.15.5:0/3192092790 >> v2:172.21.15.112:3300/0 conn(0x7ffb68148d10 msgr2=0x7ffb681427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6cc00640 1 --2- 172.21.15.5:0/3192092790 >> v2:172.21.15.112:3300/0 conn(0x7ffb68148d10 0x7ffb681427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6cc00640 1 -- 172.21.15.5:0/3192092790 >> v1:172.21.15.112:6789/0 conn(0x7ffb68142310 legacy=0x7ffb68148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.620+0000 7ffb6cc00640 1 -- 172.21.15.5:0/3192092790 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb680b6830 con 0x7ffb680bae80 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdfa0200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf98072a50 0x7fdf9813c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdfa0200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf980b9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdfa0200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf980b9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdfa0200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9813fb70 con 0x7fdf9814dcd0 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdfa0200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9813f9f0 con 0x7fdf98072a50 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdfa0200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdf98072370 con 0x7fdf980bb2e0 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdf9e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf980b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdf9e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf980b9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43834/0 (socket says 172.21.15.5:43834) 2024-04-26T21:37:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdf9e200640 1 -- 172.21.15.5:0/929495357 learned_addr learned my addr 172.21.15.5:0/929495357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.621+0000 7fdf9ce00640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf980b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9d800640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf98072a50 0x7fdf9813c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7ffb6cc00640 1 --2- 172.21.15.5:0/3192092790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb680b57d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffb6814cb20 tx=0x7ffb5c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fc9f9a0ab4a8fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9e200640 1 -- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 msgr2=0x7fdf980b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9e200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf980b9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9e200640 1 -- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf98072a50 msgr2=0x7fdf9813c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9e200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf98072a50 0x7fdf9813c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9e200640 1 -- 172.21.15.5:0/929495357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf980b9ea0 con 0x7fdf9814dcd0 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9d800640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf98072a50 0x7fdf9813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9ce00640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf980b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7ffb67400640 1 -- 172.21.15.5:0/3192092790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c037070 con 0x7ffb680bae80 2024-04-26T21:37:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7ffb67400640 1 -- 172.21.15.5:0/3192092790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c032440 con 0x7ffb680bae80 2024-04-26T21:37:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7ffb67400640 1 -- 172.21.15.5:0/3192092790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c032810 con 0x7ffb680bae80 2024-04-26T21:37:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.622+0000 7fdf9e200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf980b9960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000d150 tx=0x7fdf90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7fdf95600640 1 -- 172.21.15.5:0/929495357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90044070 con 0x7fdf9814dcd0 2024-04-26T21:37:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7fdf95600640 1 -- 172.21.15.5:0/929495357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf90003e10 con 0x7fdf9814dcd0 2024-04-26T21:37:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7fdf95600640 1 -- 172.21.15.5:0/929495357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90039070 con 0x7fdf9814dcd0 2024-04-26T21:37:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7ffb6e000640 1 -- 172.21.15.5:0/3192092790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 msgr2=0x7ffb680b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7ffb6e000640 1 --2- 172.21.15.5:0/3192092790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb680b57d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffb6814cb20 tx=0x7ffb5c02a1f0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7ffb6e000640 1 -- 172.21.15.5:0/3192092790 shutdown_connections 2024-04-26T21:37:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7ffb6e000640 1 --2- 172.21.15.5:0/3192092790 >> v2:172.21.15.112:3300/0 conn(0x7ffb68148d10 0x7ffb681427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7ffb6e000640 1 --2- 172.21.15.5:0/3192092790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb680b57d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7ffb6e000640 1 -- 172.21.15.5:0/3192092790 >> 172.21.15.5:0/3192092790 conn(0x7ffb680684b0 msgr2=0x7ffb680688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.624+0000 7ffb6e000640 1 -- 172.21.15.5:0/3192092790 shutdown_connections 2024-04-26T21:37:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9813c990 con 0x7fdf9814dcd0 2024-04-26T21:37:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.623+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf980ba370 con 0x7fdf9814dcd0 2024-04-26T21:37:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.624+0000 7ffb6e000640 1 -- 172.21.15.5:0/3192092790 wait complete. 2024-04-26T21:37:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.625+0000 7ffb6e000640 1 Processor -- start 2024-04-26T21:37:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.625+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf980b73a0 con 0x7fdf9814dcd0 2024-04-26T21:37:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.626+0000 7ffb6e000640 1 -- start start 2024-04-26T21:37:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.626+0000 7fdf95600640 1 -- 172.21.15.5:0/929495357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf9003d070 con 0x7fdf9814dcd0 2024-04-26T21:37:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb6814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb68142310 0x7ffb6814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb68148d10 0x7ffb6814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7fdf95600640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdf7806c920 0x7fdf7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68152e10 con 0x7ffb680bae80 2024-04-26T21:37:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6e000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680ba3a0 con 0x7ffb68142310 2024-04-26T21:37:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffb68152f90 con 0x7ffb68148d10 2024-04-26T21:37:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb6814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb6814c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43842/0 (socket says 172.21.15.5:43842) 2024-04-26T21:37:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb6cc00640 1 -- 172.21.15.5:0/1568334594 learned_addr learned my addr 172.21.15.5:0/1568334594 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7fdf95600640 1 -- 172.21.15.5:0/929495357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdf90035df0 con 0x7fdf9814dcd0 2024-04-26T21:37:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.627+0000 7ffb67e00640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb68142310 0x7ffb6814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.628+0000 7ffb6d600640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb68148d10 0x7ffb6814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.628+0000 7ffb6cc00640 1 -- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb68148d10 msgr2=0x7ffb6814a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.628+0000 7ffb6cc00640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb68148d10 0x7ffb6814a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.628+0000 7ffb6cc00640 1 -- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb68142310 msgr2=0x7ffb6814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.628+0000 7ffb6cc00640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb68142310 0x7ffb6814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.628+0000 7ffb6cc00640 1 -- 172.21.15.5:0/1568334594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6814b990 con 0x7ffb680bae80 2024-04-26T21:37:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.628+0000 7fdf9d800640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdf7806c920 0x7fdf7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.629+0000 7ffb6cc00640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb6814c400 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c000c00 tx=0x7ffb5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.629+0000 7fdf9d800640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdf7806c920 0x7fdf7806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c000f60 tx=0x7fdf8c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.637+0000 7ffb64c00640 1 -- 172.21.15.5:0/1568334594 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c041020 con 0x7ffb680bae80 2024-04-26T21:37:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.637+0000 7ffb64c00640 1 -- 172.21.15.5:0/1568334594 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0306c0 con 0x7ffb680bae80 2024-04-26T21:37:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.637+0000 7ffb64c00640 1 -- 172.21.15.5:0/1568334594 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c037040 con 0x7ffb680bae80 2024-04-26T21:37:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.637+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb681449d0 con 0x7ffb680bae80 2024-04-26T21:37:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.637+0000 7fdf95600640 1 -- 172.21.15.5:0/929495357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdf980b73a0 con 0x7fdf9814dcd0 2024-04-26T21:37:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.637+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6814b440 con 0x7ffb680bae80 2024-04-26T21:37:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.639+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6806c450 con 0x7ffb680bae80 2024-04-26T21:37:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.641+0000 7ffb64c00640 1 -- 172.21.15.5:0/1568334594 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb5c044020 con 0x7ffb680bae80 2024-04-26T21:37:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.642+0000 7ffb64c00640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffb4806c920 0x7ffb4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.642+0000 7ffb64c00640 1 -- 172.21.15.5:0/1568334594 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffb5c0ac670 con 0x7ffb680bae80 2024-04-26T21:37:45.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.643+0000 7ffb67e00640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffb4806c920 0x7ffb4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.644+0000 7ffb67e00640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffb4806c920 0x7ffb4806ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb68072c30 tx=0x7ffb54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.653+0000 7ffb64c00640 1 -- 172.21.15.5:0/1568334594 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffb6806c450 con 0x7ffb680bae80 2024-04-26T21:37:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.735+0000 7f0583e00640 1 Processor -- start 2024-04-26T21:37:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.736+0000 7f0583e00640 1 -- start start 2024-04-26T21:37:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.737+0000 7f0583e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05840bae80 0x7f05840b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.737+0000 7f0583e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05840bb260 con 0x7f0584142310 2024-04-26T21:37:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.737+0000 7f0583e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05840b6270 con 0x7f0584148d10 2024-04-26T21:37:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.737+0000 7f0583e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f05840b6550 con 0x7f05840bae80 2024-04-26T21:37:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.738+0000 7f0582000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0584142310 0x7f0584148600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53014/0 (socket says 172.21.15.5:53014) 2024-04-26T21:37:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.738+0000 7f0582000640 1 -- 172.21.15.5:0/1774099411 learned_addr learned my addr 172.21.15.5:0/1774099411 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.738+0000 7f0582a00640 1 --2- 172.21.15.5:0/1774099411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05840bae80 0x7f05840b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.739+0000 7f0582a00640 1 -- 172.21.15.5:0/1774099411 >> v1:172.21.15.112:6789/0 conn(0x7f0584148d10 legacy=0x7f0584152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.739+0000 7f0582a00640 1 -- 172.21.15.5:0/1774099411 >> v1:172.21.15.5:6789/0 conn(0x7f0584142310 legacy=0x7f0584148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.739+0000 7f0581600640 1 -- 172.21.15.5:0/1774099411 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148191863 0 0) 0x7f05840bb260 con 0x7f0584142310 2024-04-26T21:37:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.739+0000 7f0582a00640 1 -- 172.21.15.5:0/1774099411 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05840b6830 con 0x7f05840bae80 2024-04-26T21:37:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.741+0000 7f0582a00640 1 --2- 172.21.15.5:0/1774099411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05840bae80 0x7f05840b57d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05740097d0 tx=0x7f057402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e672f97b72efb30 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.741+0000 7f0581600640 1 -- 172.21.15.5:0/1774099411 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574037070 con 0x7f05840bae80 2024-04-26T21:37:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.741+0000 7f0581600640 1 -- 172.21.15.5:0/1774099411 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0574032440 con 0x7f05840bae80 2024-04-26T21:37:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.741+0000 7f0581600640 1 -- 172.21.15.5:0/1774099411 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574032810 con 0x7f05840bae80 2024-04-26T21:37:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.742+0000 7f0583e00640 1 -- 172.21.15.5:0/1774099411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05840bae80 msgr2=0x7f05840b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.742+0000 7f0583e00640 1 --2- 172.21.15.5:0/1774099411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05840bae80 0x7f05840b57d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05740097d0 tx=0x7f057402a1a0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.742+0000 7f0583e00640 1 -- 172.21.15.5:0/1774099411 shutdown_connections 2024-04-26T21:37:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.742+0000 7f0583e00640 1 --2- 172.21.15.5:0/1774099411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05840bae80 0x7f05840b57d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.742+0000 7f0583e00640 1 -- 172.21.15.5:0/1774099411 >> 172.21.15.5:0/1774099411 conn(0x7f05840684b0 msgr2=0x7f05840688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.742+0000 7f0583e00640 1 -- 172.21.15.5:0/1774099411 shutdown_connections 2024-04-26T21:37:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.743+0000 7f0583e00640 1 -- 172.21.15.5:0/1774099411 wait complete. 2024-04-26T21:37:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.745+0000 7f0583e00640 1 Processor -- start 2024-04-26T21:37:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.745+0000 7f0583e00640 1 -- start start 2024-04-26T21:37:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.746+0000 7f0583e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840bae80 0x7f058414c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.746+0000 7f0583e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0584142310 0x7f05841e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.746+0000 7f0583e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0584148d10 0x7f0584142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.746+0000 7f0583e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0584142770 con 0x7f0584142310 2024-04-26T21:37:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.746+0000 7f0583e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05840ba3a0 con 0x7f05840bae80 2024-04-26T21:37:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.746+0000 7f0583e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f05841428f0 con 0x7f0584148d10 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.747+0000 7f0582000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0584142310 0x7f05841e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.747+0000 7f0582000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0584142310 0x7f05841e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43852/0 (socket says 172.21.15.5:43852) 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.747+0000 7f0582000640 1 -- 172.21.15.5:0/1070779279 learned_addr learned my addr 172.21.15.5:0/1070779279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.747+0000 7f0582a00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840bae80 0x7f058414c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.747+0000 7f0583400640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0584148d10 0x7f0584142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.748+0000 7f0582000640 1 -- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0584148d10 msgr2=0x7f0584142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.748+0000 7f0582000640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0584148d10 0x7f0584142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.748+0000 7f0582000640 1 -- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840bae80 msgr2=0x7f058414c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.748+0000 7f0582000640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840bae80 0x7f058414c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.748+0000 7f0582000640 1 -- 172.21.15.5:0/1070779279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05841e0d00 con 0x7f0584142310 2024-04-26T21:37:45.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.748+0000 7f0582000640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0584142310 0x7f05841e17e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f057000c430 tx=0x7f057000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.748+0000 7f057aa00640 1 -- 172.21.15.5:0/1070779279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700074e0 con 0x7f0584142310 2024-04-26T21:37:45.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.749+0000 7f057aa00640 1 -- 172.21.15.5:0/1070779279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05700047e0 con 0x7f0584142310 2024-04-26T21:37:45.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.749+0000 7f057aa00640 1 -- 172.21.15.5:0/1070779279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570004bb0 con 0x7f0584142310 2024-04-26T21:37:45.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.749+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05841e0fe0 con 0x7f0584142310 2024-04-26T21:37:45.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.749+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058414bc90 con 0x7f0584142310 2024-04-26T21:37:45.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.751+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0584075db0 con 0x7f0584142310 2024-04-26T21:37:45.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.753+0000 7f057aa00640 1 -- 172.21.15.5:0/1070779279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0570011070 con 0x7f0584142310 2024-04-26T21:37:45.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.755+0000 7f057aa00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f056406c940 0x7f056406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:45.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.755+0000 7f057aa00640 1 -- 172.21.15.5:0/1070779279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f057008b950 con 0x7f0584142310 2024-04-26T21:37:45.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.755+0000 7f0582a00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f056406c940 0x7f056406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:45.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.757+0000 7f0582a00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f056406c940 0x7f056406ee00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0574034000 tx=0x7f057402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:45.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.763+0000 7f057aa00640 1 -- 172.21.15.5:0/1070779279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0570059460 con 0x7f0584142310 2024-04-26T21:37:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.812+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6e3c141380 con 0x7f6e3c0bae80 2024-04-26T21:37:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.813+0000 7f6e33400640 1 -- 172.21.15.5:0/2563690834 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e2c058bb0 con 0x7f6e3c0bae80 2024-04-26T21:37:45.814 INFO:teuthology.orchestra.run.smithi005.stdout:55834574859 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6e1c06c940 msgr2=0x7f6e1c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6e1c06c940 0x7f6e1c06ee00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c14cb40 tx=0x7f6e28009040 comp rx=0 tx=0).stop 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c0bae80 msgr2=0x7f6e3c14a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c0bae80 0x7f6e3c14a910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c4a0 tx=0x7f6e2c00c960 comp rx=0 tx=0).stop 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 shutdown_connections 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c148d10 0x7f6e3c1e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c142a20 0x7f6e3c14b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6e1c06c940 0x7f6e1c06ee00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 --2- 172.21.15.5:0/2563690834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e3c0bae80 0x7f6e3c14a910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 >> 172.21.15.5:0/2563690834 conn(0x7f6e3c0684b0 msgr2=0x7f6e3c1420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.816+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 shutdown_connections 2024-04-26T21:37:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.817+0000 7f6e40c00640 1 -- 172.21.15.5:0/2563690834 wait complete. 2024-04-26T21:37:45.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.5 2024-04-26T21:37:45.841 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:45.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.858+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdf98075db0 con 0x7fdf9814dcd0 2024-04-26T21:37:45.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.858+0000 7fdf95600640 1 -- 172.21.15.5:0/929495357 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf9007a110 con 0x7fdf9814dcd0 2024-04-26T21:37:45.859 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2024-04-26T21:37:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdf7806c920 msgr2=0x7fdf7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdf7806c920 0x7fdf7806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c000f60 tx=0x7fdf8c009040 comp rx=0 tx=0).stop 2024-04-26T21:37:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 msgr2=0x7fdf980b9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf980b9960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000d150 tx=0x7fdf90004a40 comp rx=0 tx=0).stop 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 shutdown_connections 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fdf7806c920 0x7fdf7806ede0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf9814dcd0 0x7fdf980b9960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf980bb2e0 0x7fdf980b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 --2- 172.21.15.5:0/929495357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf98072a50 0x7fdf9813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 >> 172.21.15.5:0/929495357 conn(0x7fdf9806d5f0 msgr2=0x7fdf980b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 shutdown_connections 2024-04-26T21:37:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.861+0000 7fdfa0200640 1 -- 172.21.15.5:0/929495357 wait complete. 2024-04-26T21:37:45.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.3 2024-04-26T21:37:45.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.878+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f04f4005850 con 0x7f051c14bb70 2024-04-26T21:37:45.878 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.878+0000 7f0513400640 1 -- 172.21.15.5:0/3892958931 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f051405d6e0 con 0x7f051c14bb70 2024-04-26T21:37:45.879 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f04fc06c920 msgr2=0x7f04fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f04fc06c920 0x7f04fc06ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f050c034000 tx=0x7f050c02e000 comp rx=0 tx=0).stop 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c14bb70 msgr2=0x7f051c13b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c14bb70 0x7f051c13b0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f051400ef00 tx=0x7f051400b480 comp rx=0 tx=0).stop 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 shutdown_connections 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f04fc06c920 0x7f04fc06ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051c14bb70 0x7f051c13b0c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c1429a0 0x7f051c0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.880+0000 7f0522000640 1 --2- 172.21.15.5:0/3892958931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f051c0b68f0 0x7f051c0be6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.881+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 >> 172.21.15.5:0/3892958931 conn(0x7f051c068480 msgr2=0x7f051c148f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.881+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 shutdown_connections 2024-04-26T21:37:45.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.881+0000 7f0522000640 1 -- 172.21.15.5:0/3892958931 wait complete. 2024-04-26T21:37:45.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.7 2024-04-26T21:37:45.897 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.909+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ffb68145590 con 0x7ffb680bae80 2024-04-26T21:37:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.910+0000 7ffb64c00640 1 -- 172.21.15.5:0/1568334594 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffb5c04b030 con 0x7ffb680bae80 2024-04-26T21:37:45.910 INFO:teuthology.orchestra.run.smithi005.stdout:55834574859 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffb4806c920 msgr2=0x7ffb4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffb4806c920 0x7ffb4806ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb68072c30 tx=0x7ffb54009040 comp rx=0 tx=0).stop 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 msgr2=0x7ffb6814c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb6814c400 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c000c00 tx=0x7ffb5c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 shutdown_connections 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffb68148d10 0x7ffb6814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb68142310 0x7ffb6814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ffb4806c920 0x7ffb4806ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 --2- 172.21.15.5:0/1568334594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb680bae80 0x7ffb6814c400 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 >> 172.21.15.5:0/1568334594 conn(0x7ffb680684b0 msgr2=0x7ffb681477d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 shutdown_connections 2024-04-26T21:37:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:45.912+0000 7ffb6e000640 1 -- 172.21.15.5:0/1568334594 wait complete. 2024-04-26T21:37:45.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.4 2024-04-26T21:37:45.928 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:46.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.010+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f05841e1500 con 0x7f0584142310 2024-04-26T21:37:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.011+0000 7f057aa00640 1 -- 172.21.15.5:0/1070779279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f057005d760 con 0x7f0584142310 2024-04-26T21:37:46.011 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2024-04-26T21:37:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f056406c940 msgr2=0x7f056406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f056406c940 0x7f056406ee00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0574034000 tx=0x7f057402e000 comp rx=0 tx=0).stop 2024-04-26T21:37:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0584142310 msgr2=0x7f05841e17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0584142310 0x7f05841e17e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f057000c430 tx=0x7f057000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 shutdown_connections 2024-04-26T21:37:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0584148d10 0x7f0584142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f056406c940 0x7f056406ee00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0584142310 0x7f05841e17e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 --2- 172.21.15.5:0/1070779279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840bae80 0x7f058414c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 >> 172.21.15.5:0/1070779279 conn(0x7f05840684b0 msgr2=0x7f0584075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 shutdown_connections 2024-04-26T21:37:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.014+0000 7f0583e00640 1 -- 172.21.15.5:0/1070779279 wait complete. 2024-04-26T21:37:46.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2024-04-26T21:37:46.033 DEBUG:teuthology.parallel:result is None 2024-04-26T21:37:46.033 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T21:37:46.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:37:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.225+0000 7f4e32c00640 1 Processor -- start 2024-04-26T21:37:46.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.226+0000 7f4e32c00640 1 -- start start 2024-04-26T21:37:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.227+0000 7f4e32c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e2c148d10 0x7f4e2c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.227+0000 7f4e32c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2c0bb260 con 0x7f4e2c0bae80 2024-04-26T21:37:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.227+0000 7f4e32c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2c0b6270 con 0x7f4e2c142a20 2024-04-26T21:37:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.227+0000 7f4e32c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2c0b6550 con 0x7f4e2c148d10 2024-04-26T21:37:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.227+0000 7f4e31800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4e2c0bae80 0x7f4e2c142310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53030/0 (socket says 172.21.15.5:53030) 2024-04-26T21:37:46.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.227+0000 7f4e31800640 1 -- 172.21.15.5:0/2047733142 learned_addr learned my addr 172.21.15.5:0/2047733142 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.227+0000 7f4e32200640 1 --2- 172.21.15.5:0/2047733142 >> v2:172.21.15.5:3300/0 conn(0x7f4e2c148d10 0x7f4e2c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.228+0000 7f4e2be00640 1 -- 172.21.15.5:0/2047733142 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764170421 0 0) 0x7f4e2c0bb260 con 0x7f4e2c0bae80 2024-04-26T21:37:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.228+0000 7f4e2be00640 1 -- 172.21.15.5:0/2047733142 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e10003520 con 0x7f4e2c0bae80 2024-04-26T21:37:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.228+0000 7f4e32200640 1 -- 172.21.15.5:0/2047733142 >> v1:172.21.15.112:6789/0 conn(0x7f4e2c142a20 legacy=0x7f4e2c148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.228+0000 7f4e32200640 1 -- 172.21.15.5:0/2047733142 >> v1:172.21.15.5:6789/0 conn(0x7f4e2c0bae80 legacy=0x7f4e2c142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.228+0000 7f4e32200640 1 -- 172.21.15.5:0/2047733142 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c0b6830 con 0x7f4e2c148d10 2024-04-26T21:37:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.229+0000 7f4e32200640 1 --2- 172.21.15.5:0/2047733142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c0b57d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009d90 tx=0x7f4e2402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d393c6df477f449f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.229+0000 7f4e2be00640 1 -- 172.21.15.5:0/2047733142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24007740 con 0x7f4e2c148d10 2024-04-26T21:37:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.229+0000 7f4e2be00640 1 -- 172.21.15.5:0/2047733142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e240078e0 con 0x7f4e2c148d10 2024-04-26T21:37:46.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.229+0000 7f4e2be00640 1 -- 172.21.15.5:0/2047733142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24007cb0 con 0x7f4e2c148d10 2024-04-26T21:37:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.230+0000 7f4e32c00640 1 -- 172.21.15.5:0/2047733142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 msgr2=0x7f4e2c0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.230+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2047733142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c0b57d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009d90 tx=0x7f4e2402a660 comp rx=0 tx=0).stop 2024-04-26T21:37:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.230+0000 7f4e32c00640 1 -- 172.21.15.5:0/2047733142 shutdown_connections 2024-04-26T21:37:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.230+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2047733142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c0b57d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.230+0000 7f4e32c00640 1 -- 172.21.15.5:0/2047733142 >> 172.21.15.5:0/2047733142 conn(0x7f4e2c0684b0 msgr2=0x7f4e2c0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.230+0000 7f4e32c00640 1 -- 172.21.15.5:0/2047733142 shutdown_connections 2024-04-26T21:37:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.230+0000 7f4e32c00640 1 -- 172.21.15.5:0/2047733142 wait complete. 2024-04-26T21:37:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.231+0000 7f4e32c00640 1 Processor -- start 2024-04-26T21:37:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.231+0000 7f4e32c00640 1 -- start start 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e2c0bae80 0x7f4e2c147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e2c142a20 0x7f4e2c144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c1431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c153fa0 con 0x7f4e2c148d10 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c153e20 con 0x7f4e2c142a20 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c154120 con 0x7f4e2c0bae80 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c1431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c1431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43872/0 (socket says 172.21.15.5:43872) 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.232+0000 7f4e32200640 1 -- 172.21.15.5:0/2773068326 learned_addr learned my addr 172.21.15.5:0/2773068326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e32200640 1 -- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e2c0bae80 msgr2=0x7f4e2c147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e31800640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e2c0bae80 0x7f4e2c147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e30e00640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e2c142a20 0x7f4e2c144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e32200640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e2c0bae80 0x7f4e2c147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e32200640 1 -- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e2c142a20 msgr2=0x7f4e2c144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e32200640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e2c142a20 0x7f4e2c144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e32200640 1 -- 172.21.15.5:0/2773068326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c145160 con 0x7f4e2c148d10 2024-04-26T21:37:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e32200640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c1431c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009eb0 tx=0x7f4e24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e29600640 1 -- 172.21.15.5:0/2773068326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2403f070 con 0x7f4e2c148d10 2024-04-26T21:37:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e29600640 1 -- 172.21.15.5:0/2773068326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e24031bc0 con 0x7f4e2c148d10 2024-04-26T21:37:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e29600640 1 -- 172.21.15.5:0/2773068326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24009450 con 0x7f4e2c148d10 2024-04-26T21:37:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.233+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c14c300 con 0x7f4e2c148d10 2024-04-26T21:37:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.234+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c0bca30 con 0x7f4e2c148d10 2024-04-26T21:37:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.235+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c145f50 con 0x7f4e2c148d10 2024-04-26T21:37:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.235+0000 7f4e29600640 1 -- 172.21.15.5:0/2773068326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e2403b410 con 0x7f4e2c148d10 2024-04-26T21:37:46.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.236+0000 7f4e29600640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4e0c06c920 0x7f4e0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.236+0000 7f4e29600640 1 -- 172.21.15.5:0/2773068326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e240ad5f0 con 0x7f4e2c148d10 2024-04-26T21:37:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.237+0000 7f4e31800640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4e0c06c920 0x7f4e0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.238+0000 7f4e31800640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4e0c06c920 0x7f4e0c06ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0011e0 tx=0x7f4e1c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.240+0000 7f4e29600640 1 -- 172.21.15.5:0/2773068326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e2407b6d0 con 0x7f4e2c148d10 2024-04-26T21:37:46.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.434+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e2c0b8fb0 con 0x7f4e0c06c920 2024-04-26T21:37:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.461+0000 7f4e29600640 1 -- 172.21.15.5:0/2773068326 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7f4e2c0b8fb0 con 0x7f4e0c06c920 2024-04-26T21:37:46.465 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4e0c06c920 msgr2=0x7f4e0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4e0c06c920 0x7f4e0c06ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0011e0 tx=0x7f4e1c009040 comp rx=0 tx=0).stop 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 msgr2=0x7f4e2c1431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c1431c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009eb0 tx=0x7f4e24004a40 comp rx=0 tx=0).stop 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 shutdown_connections 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4e0c06c920 0x7f4e0c06ede0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e2c148d10 0x7f4e2c1431c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e2c142a20 0x7f4e2c144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 --2- 172.21.15.5:0/2773068326 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e2c0bae80 0x7f4e2c147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 >> 172.21.15.5:0/2773068326 conn(0x7f4e2c0684b0 msgr2=0x7f4e2c075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 shutdown_connections 2024-04-26T21:37:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.466+0000 7f4e32c00640 1 -- 172.21.15.5:0/2773068326 wait complete. 2024-04-26T21:37:46.483 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T21:37:45.461437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227704,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747016,"statfs":{"total":773094113280,"available":772860944384,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":229756468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005883"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007792+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T21:37:23.007792+0000","last_peered":"2024-04-26T21:37:23.007792+0000","last_clean":"2024-04-26T21:37:23.007792+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T21:37:23.007792+0000","last_undegraded":"2024-04-26T21:37:23.007792+0000","last_fullsized":"2024-04-26T21:37:23.007792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:32.834699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504581+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T21:37:22.504581+0000","last_peered":"2024-04-26T21:37:22.504581+0000","last_clean":"2024-04-26T21:37:22.504581+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T21:37:22.504581+0000","last_undegraded":"2024-04-26T21:37:22.504581+0000","last_fullsized":"2024-04-26T21:37:22.504581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502119+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T21:37:22.502119+0000","last_peered":"2024-04-26T21:37:22.502119+0000","last_clean":"2024-04-26T21:37:22.502119+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T21:37:22.502119+0000","last_undegraded":"2024-04-26T21:37:22.502119+0000","last_fullsized":"2024-04-26T21:37:22.502119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505039+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T21:37:22.505039+0000","last_peered":"2024-04-26T21:37:22.505039+0000","last_clean":"2024-04-26T21:37:22.505039+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T21:37:22.505039+0000","last_undegraded":"2024-04-26T21:37:22.505039+0000","last_fullsized":"2024-04-26T21:37:22.505039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006872+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T21:37:23.006872+0000","last_peered":"2024-04-26T21:37:23.006872+0000","last_clean":"2024-04-26T21:37:23.006872+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T21:37:23.006872+0000","last_undegraded":"2024-04-26T21:37:23.006872+0000","last_fullsized":"2024-04-26T21:37:23.006872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897958+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T21:37:22.897958+0000","last_peered":"2024-04-26T21:37:22.897958+0000","last_clean":"2024-04-26T21:37:22.897958+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T21:37:22.897958+0000","last_undegraded":"2024-04-26T21:37:22.897958+0000","last_fullsized":"2024-04-26T21:37:22.897958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009318+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T21:37:23.009318+0000","last_peered":"2024-04-26T21:37:23.009318+0000","last_clean":"2024-04-26T21:37:23.009318+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T21:37:23.009318+0000","last_undegraded":"2024-04-26T21:37:23.009318+0000","last_fullsized":"2024-04-26T21:37:23.009318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835366+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T21:37:22.835366+0000","last_peered":"2024-04-26T21:37:22.835366+0000","last_clean":"2024-04-26T21:37:22.835366+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T21:37:22.835366+0000","last_undegraded":"2024-04-26T21:37:22.835366+0000","last_fullsized":"2024-04-26T21:37:22.835366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897760+0000","last_change":"2024-04-26T21:37:21.501976+0000","last_active":"2024-04-26T21:37:22.897760+0000","last_peered":"2024-04-26T21:37:22.897760+0000","last_clean":"2024-04-26T21:37:22.897760+0000","last_became_active":"2024-04-26T21:37:21.501426+0000","last_became_peered":"2024-04-26T21:37:21.501426+0000","last_unstale":"2024-04-26T21:37:22.897760+0000","last_undegraded":"2024-04-26T21:37:22.897760+0000","last_fullsized":"2024-04-26T21:37:22.897760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:44.895996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008636+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T21:37:23.008636+0000","last_peered":"2024-04-26T21:37:23.008636+0000","last_clean":"2024-04-26T21:37:23.008636+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T21:37:23.008636+0000","last_undegraded":"2024-04-26T21:37:23.008636+0000","last_fullsized":"2024-04-26T21:37:23.008636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835679+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T21:37:22.835679+0000","last_peered":"2024-04-26T21:37:22.835679+0000","last_clean":"2024-04-26T21:37:22.835679+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T21:37:22.835679+0000","last_undegraded":"2024-04-26T21:37:22.835679+0000","last_fullsized":"2024-04-26T21:37:22.835679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897630+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T21:37:22.897630+0000","last_peered":"2024-04-26T21:37:22.897630+0000","last_clean":"2024-04-26T21:37:22.897630+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T21:37:22.897630+0000","last_undegraded":"2024-04-26T21:37:22.897630+0000","last_fullsized":"2024-04-26T21:37:22.897630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503627+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T21:37:22.503627+0000","last_peered":"2024-04-26T21:37:22.503627+0000","last_clean":"2024-04-26T21:37:22.503627+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T21:37:22.503627+0000","last_undegraded":"2024-04-26T21:37:22.503627+0000","last_fullsized":"2024-04-26T21:37:22.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008824+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T21:37:23.008824+0000","last_peered":"2024-04-26T21:37:23.008824+0000","last_clean":"2024-04-26T21:37:23.008824+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T21:37:23.008824+0000","last_undegraded":"2024-04-26T21:37:23.008824+0000","last_fullsized":"2024-04-26T21:37:23.008824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898971+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T21:37:22.898971+0000","last_peered":"2024-04-26T21:37:22.898971+0000","last_clean":"2024-04-26T21:37:22.898971+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T21:37:22.898971+0000","last_undegraded":"2024-04-26T21:37:22.898971+0000","last_fullsized":"2024-04-26T21:37:22.898971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503070+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T21:37:22.503070+0000","last_peered":"2024-04-26T21:37:22.503070+0000","last_clean":"2024-04-26T21:37:22.503070+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T21:37:22.503070+0000","last_undegraded":"2024-04-26T21:37:22.503070+0000","last_fullsized":"2024-04-26T21:37:22.503070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008916+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T21:37:23.008916+0000","last_peered":"2024-04-26T21:37:23.008916+0000","last_clean":"2024-04-26T21:37:23.008916+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T21:37:23.008916+0000","last_undegraded":"2024-04-26T21:37:23.008916+0000","last_fullsized":"2024-04-26T21:37:23.008916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898299+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T21:37:22.898299+0000","last_peered":"2024-04-26T21:37:22.898299+0000","last_clean":"2024-04-26T21:37:22.898299+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T21:37:22.898299+0000","last_undegraded":"2024-04-26T21:37:22.898299+0000","last_fullsized":"2024-04-26T21:37:22.898299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502408+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T21:37:22.502408+0000","last_peered":"2024-04-26T21:37:22.502408+0000","last_clean":"2024-04-26T21:37:22.502408+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T21:37:22.502408+0000","last_undegraded":"2024-04-26T21:37:22.502408+0000","last_fullsized":"2024-04-26T21:37:22.502408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007771+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T21:37:23.007771+0000","last_peered":"2024-04-26T21:37:23.007771+0000","last_clean":"2024-04-26T21:37:23.007771+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T21:37:23.007771+0000","last_undegraded":"2024-04-26T21:37:23.007771+0000","last_fullsized":"2024-04-26T21:37:23.007771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009132+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T21:37:23.009132+0000","last_peered":"2024-04-26T21:37:23.009132+0000","last_clean":"2024-04-26T21:37:23.009132+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T21:37:23.009132+0000","last_undegraded":"2024-04-26T21:37:23.009132+0000","last_fullsized":"2024-04-26T21:37:23.009132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898265+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T21:37:22.898265+0000","last_peered":"2024-04-26T21:37:22.898265+0000","last_clean":"2024-04-26T21:37:22.898265+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T21:37:22.898265+0000","last_undegraded":"2024-04-26T21:37:22.898265+0000","last_fullsized":"2024-04-26T21:37:22.898265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007818+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T21:37:23.007818+0000","last_peered":"2024-04-26T21:37:23.007818+0000","last_clean":"2024-04-26T21:37:23.007818+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T21:37:23.007818+0000","last_undegraded":"2024-04-26T21:37:23.007818+0000","last_fullsized":"2024-04-26T21:37:23.007818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898858+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T21:37:22.898858+0000","last_peered":"2024-04-26T21:37:22.898858+0000","last_clean":"2024-04-26T21:37:22.898858+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T21:37:22.898858+0000","last_undegraded":"2024-04-26T21:37:22.898858+0000","last_fullsized":"2024-04-26T21:37:22.898858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007135+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T21:37:23.007135+0000","last_peered":"2024-04-26T21:37:23.007135+0000","last_clean":"2024-04-26T21:37:23.007135+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T21:37:23.007135+0000","last_undegraded":"2024-04-26T21:37:23.007135+0000","last_fullsized":"2024-04-26T21:37:23.007135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505636+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T21:37:22.505636+0000","last_peered":"2024-04-26T21:37:22.505636+0000","last_clean":"2024-04-26T21:37:22.505636+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T21:37:22.505636+0000","last_undegraded":"2024-04-26T21:37:22.505636+0000","last_fullsized":"2024-04-26T21:37:22.505636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897853+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T21:37:22.897853+0000","last_peered":"2024-04-26T21:37:22.897853+0000","last_clean":"2024-04-26T21:37:22.897853+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T21:37:22.897853+0000","last_undegraded":"2024-04-26T21:37:22.897853+0000","last_fullsized":"2024-04-26T21:37:22.897853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504219+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T21:37:22.504219+0000","last_peered":"2024-04-26T21:37:22.504219+0000","last_clean":"2024-04-26T21:37:22.504219+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T21:37:22.504219+0000","last_undegraded":"2024-04-26T21:37:22.504219+0000","last_fullsized":"2024-04-26T21:37:22.504219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009255+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T21:37:23.009255+0000","last_peered":"2024-04-26T21:37:23.009255+0000","last_clean":"2024-04-26T21:37:23.009255+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T21:37:23.009255+0000","last_undegraded":"2024-04-26T21:37:23.009255+0000","last_fullsized":"2024-04-26T21:37:23.009255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501932+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T21:37:22.501932+0000","last_peered":"2024-04-26T21:37:22.501932+0000","last_clean":"2024-04-26T21:37:22.501932+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T21:37:22.501932+0000","last_undegraded":"2024-04-26T21:37:22.501932+0000","last_fullsized":"2024-04-26T21:37:22.501932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008562+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T21:37:23.008562+0000","last_peered":"2024-04-26T21:37:23.008562+0000","last_clean":"2024-04-26T21:37:23.008562+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T21:37:23.008562+0000","last_undegraded":"2024-04-26T21:37:23.008562+0000","last_fullsized":"2024-04-26T21:37:23.008562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009625+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T21:37:23.009625+0000","last_peered":"2024-04-26T21:37:23.009625+0000","last_clean":"2024-04-26T21:37:23.009625+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T21:37:23.009625+0000","last_undegraded":"2024-04-26T21:37:23.009625+0000","last_fullsized":"2024-04-26T21:37:23.009625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006714+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T21:37:23.006714+0000","last_peered":"2024-04-26T21:37:23.006714+0000","last_clean":"2024-04-26T21:37:23.006714+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T21:37:23.006714+0000","last_undegraded":"2024-04-26T21:37:23.006714+0000","last_fullsized":"2024-04-26T21:37:23.006714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836004+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T21:37:22.836004+0000","last_peered":"2024-04-26T21:37:22.836004+0000","last_clean":"2024-04-26T21:37:22.836004+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T21:37:22.836004+0000","last_undegraded":"2024-04-26T21:37:22.836004+0000","last_fullsized":"2024-04-26T21:37:22.836004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008627+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T21:37:23.008627+0000","last_peered":"2024-04-26T21:37:23.008627+0000","last_clean":"2024-04-26T21:37:23.008627+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T21:37:23.008627+0000","last_undegraded":"2024-04-26T21:37:23.008627+0000","last_fullsized":"2024-04-26T21:37:23.008627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008859+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T21:37:23.008859+0000","last_peered":"2024-04-26T21:37:23.008859+0000","last_clean":"2024-04-26T21:37:23.008859+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T21:37:23.008859+0000","last_undegraded":"2024-04-26T21:37:23.008859+0000","last_fullsized":"2024-04-26T21:37:23.008859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898544+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T21:37:22.898544+0000","last_peered":"2024-04-26T21:37:22.898544+0000","last_clean":"2024-04-26T21:37:22.898544+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T21:37:22.898544+0000","last_undegraded":"2024-04-26T21:37:22.898544+0000","last_fullsized":"2024-04-26T21:37:22.898544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835574+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T21:37:22.835574+0000","last_peered":"2024-04-26T21:37:22.835574+0000","last_clean":"2024-04-26T21:37:22.835574+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T21:37:22.835574+0000","last_undegraded":"2024-04-26T21:37:22.835574+0000","last_fullsized":"2024-04-26T21:37:22.835574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008566+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T21:37:23.008566+0000","last_peered":"2024-04-26T21:37:23.008566+0000","last_clean":"2024-04-26T21:37:23.008566+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T21:37:23.008566+0000","last_undegraded":"2024-04-26T21:37:23.008566+0000","last_fullsized":"2024-04-26T21:37:23.008566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007854+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T21:37:23.007854+0000","last_peered":"2024-04-26T21:37:23.007854+0000","last_clean":"2024-04-26T21:37:23.007854+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T21:37:23.007854+0000","last_undegraded":"2024-04-26T21:37:23.007854+0000","last_fullsized":"2024-04-26T21:37:23.007854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505152+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T21:37:22.505152+0000","last_peered":"2024-04-26T21:37:22.505152+0000","last_clean":"2024-04-26T21:37:22.505152+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T21:37:22.505152+0000","last_undegraded":"2024-04-26T21:37:22.505152+0000","last_fullsized":"2024-04-26T21:37:22.505152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009481+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T21:37:23.009481+0000","last_peered":"2024-04-26T21:37:23.009481+0000","last_clean":"2024-04-26T21:37:23.009481+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T21:37:23.009481+0000","last_undegraded":"2024-04-26T21:37:23.009481+0000","last_fullsized":"2024-04-26T21:37:23.009481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005333+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T21:37:23.005333+0000","last_peered":"2024-04-26T21:37:23.005333+0000","last_clean":"2024-04-26T21:37:23.005333+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T21:37:23.005333+0000","last_undegraded":"2024-04-26T21:37:23.005333+0000","last_fullsized":"2024-04-26T21:37:23.005333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:03.104148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007821+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T21:37:23.007821+0000","last_peered":"2024-04-26T21:37:23.007821+0000","last_clean":"2024-04-26T21:37:23.007821+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T21:37:23.007821+0000","last_undegraded":"2024-04-26T21:37:23.007821+0000","last_fullsized":"2024-04-26T21:37:23.007821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007190+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T21:37:23.007190+0000","last_peered":"2024-04-26T21:37:23.007190+0000","last_clean":"2024-04-26T21:37:23.007190+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T21:37:23.007190+0000","last_undegraded":"2024-04-26T21:37:23.007190+0000","last_fullsized":"2024-04-26T21:37:23.007190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502972+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T21:37:22.502972+0000","last_peered":"2024-04-26T21:37:22.502972+0000","last_clean":"2024-04-26T21:37:22.502972+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T21:37:22.502972+0000","last_undegraded":"2024-04-26T21:37:22.502972+0000","last_fullsized":"2024-04-26T21:37:22.502972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835398+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T21:37:22.835398+0000","last_peered":"2024-04-26T21:37:22.835398+0000","last_clean":"2024-04-26T21:37:22.835398+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T21:37:22.835398+0000","last_undegraded":"2024-04-26T21:37:22.835398+0000","last_fullsized":"2024-04-26T21:37:22.835398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008149+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T21:37:23.008149+0000","last_peered":"2024-04-26T21:37:23.008149+0000","last_clean":"2024-04-26T21:37:23.008149+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T21:37:23.008149+0000","last_undegraded":"2024-04-26T21:37:23.008149+0000","last_fullsized":"2024-04-26T21:37:23.008149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504892+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T21:37:22.504892+0000","last_peered":"2024-04-26T21:37:22.504892+0000","last_clean":"2024-04-26T21:37:22.504892+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T21:37:22.504892+0000","last_undegraded":"2024-04-26T21:37:22.504892+0000","last_fullsized":"2024-04-26T21:37:22.504892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008990+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T21:37:23.008990+0000","last_peered":"2024-04-26T21:37:23.008990+0000","last_clean":"2024-04-26T21:37:23.008990+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T21:37:23.008990+0000","last_undegraded":"2024-04-26T21:37:23.008990+0000","last_fullsized":"2024-04-26T21:37:23.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506652+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T21:37:22.506652+0000","last_peered":"2024-04-26T21:37:22.506652+0000","last_clean":"2024-04-26T21:37:22.506652+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T21:37:22.506652+0000","last_undegraded":"2024-04-26T21:37:22.506652+0000","last_fullsized":"2024-04-26T21:37:22.506652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503917+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T21:37:22.503917+0000","last_peered":"2024-04-26T21:37:22.503917+0000","last_clean":"2024-04-26T21:37:22.503917+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T21:37:22.503917+0000","last_undegraded":"2024-04-26T21:37:22.503917+0000","last_fullsized":"2024-04-26T21:37:22.503917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835628+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T21:37:22.835628+0000","last_peered":"2024-04-26T21:37:22.835628+0000","last_clean":"2024-04-26T21:37:22.835628+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T21:37:22.835628+0000","last_undegraded":"2024-04-26T21:37:22.835628+0000","last_fullsized":"2024-04-26T21:37:22.835628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008941+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T21:37:23.008941+0000","last_peered":"2024-04-26T21:37:23.008941+0000","last_clean":"2024-04-26T21:37:23.008941+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T21:37:23.008941+0000","last_undegraded":"2024-04-26T21:37:23.008941+0000","last_fullsized":"2024-04-26T21:37:23.008941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006971+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T21:37:23.006971+0000","last_peered":"2024-04-26T21:37:23.006971+0000","last_clean":"2024-04-26T21:37:23.006971+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T21:37:23.006971+0000","last_undegraded":"2024-04-26T21:37:23.006971+0000","last_fullsized":"2024-04-26T21:37:23.006971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009805+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T21:37:23.009805+0000","last_peered":"2024-04-26T21:37:23.009805+0000","last_clean":"2024-04-26T21:37:23.009805+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T21:37:23.009805+0000","last_undegraded":"2024-04-26T21:37:23.009805+0000","last_fullsized":"2024-04-26T21:37:23.009805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506616+0000","last_change":"2024-04-26T21:37:16.418849+0000","last_active":"2024-04-26T21:37:22.506616+0000","last_peered":"2024-04-26T21:37:22.506616+0000","last_clean":"2024-04-26T21:37:22.506616+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T21:37:22.506616+0000","last_undegraded":"2024-04-26T21:37:22.506616+0000","last_fullsized":"2024-04-26T21:37:22.506616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834725+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T21:37:22.834725+0000","last_peered":"2024-04-26T21:37:22.834725+0000","last_clean":"2024-04-26T21:37:22.834725+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T21:37:22.834725+0000","last_undegraded":"2024-04-26T21:37:22.834725+0000","last_fullsized":"2024-04-26T21:37:22.834725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009172+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T21:37:23.009172+0000","last_peered":"2024-04-26T21:37:23.009172+0000","last_clean":"2024-04-26T21:37:23.009172+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T21:37:23.009172+0000","last_undegraded":"2024-04-26T21:37:23.009172+0000","last_fullsized":"2024-04-26T21:37:23.009172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.899073+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T21:37:22.899073+0000","last_peered":"2024-04-26T21:37:22.899073+0000","last_clean":"2024-04-26T21:37:22.899073+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T21:37:22.899073+0000","last_undegraded":"2024-04-26T21:37:22.899073+0000","last_fullsized":"2024-04-26T21:37:22.899073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897301+0000","last_change":"2024-04-26T21:37:21.502051+0000","last_active":"2024-04-26T21:37:22.897301+0000","last_peered":"2024-04-26T21:37:22.897301+0000","last_clean":"2024-04-26T21:37:22.897301+0000","last_became_active":"2024-04-26T21:37:21.501344+0000","last_became_peered":"2024-04-26T21:37:21.501344+0000","last_unstale":"2024-04-26T21:37:22.897301+0000","last_undegraded":"2024-04-26T21:37:22.897301+0000","last_fullsized":"2024-04-26T21:37:22.897301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:09.470569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008124+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T21:37:23.008124+0000","last_peered":"2024-04-26T21:37:23.008124+0000","last_clean":"2024-04-26T21:37:23.008124+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T21:37:23.008124+0000","last_undegraded":"2024-04-26T21:37:23.008124+0000","last_fullsized":"2024-04-26T21:37:23.008124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505059+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T21:37:22.505059+0000","last_peered":"2024-04-26T21:37:22.505059+0000","last_clean":"2024-04-26T21:37:22.505059+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T21:37:22.505059+0000","last_undegraded":"2024-04-26T21:37:22.505059+0000","last_fullsized":"2024-04-26T21:37:22.505059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007063+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T21:37:23.007063+0000","last_peered":"2024-04-26T21:37:23.007063+0000","last_clean":"2024-04-26T21:37:23.007063+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T21:37:23.007063+0000","last_undegraded":"2024-04-26T21:37:23.007063+0000","last_fullsized":"2024-04-26T21:37:23.007063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504231+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T21:37:22.504231+0000","last_peered":"2024-04-26T21:37:22.504231+0000","last_clean":"2024-04-26T21:37:22.504231+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T21:37:22.504231+0000","last_undegraded":"2024-04-26T21:37:22.504231+0000","last_fullsized":"2024-04-26T21:37:22.504231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503921+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T21:37:22.503921+0000","last_peered":"2024-04-26T21:37:22.503921+0000","last_clean":"2024-04-26T21:37:22.503921+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T21:37:22.503921+0000","last_undegraded":"2024-04-26T21:37:22.503921+0000","last_fullsized":"2024-04-26T21:37:22.503921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503817+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T21:37:22.503817+0000","last_peered":"2024-04-26T21:37:22.503817+0000","last_clean":"2024-04-26T21:37:22.503817+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T21:37:22.503817+0000","last_undegraded":"2024-04-26T21:37:22.503817+0000","last_fullsized":"2024-04-26T21:37:22.503817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008565+0000","last_change":"2024-04-26T21:37:17.449356+0000","last_active":"2024-04-26T21:37:23.008565+0000","last_peered":"2024-04-26T21:37:23.008565+0000","last_clean":"2024-04-26T21:37:23.008565+0000","last_became_active":"2024-04-26T21:37:17.449065+0000","last_became_peered":"2024-04-26T21:37:17.449065+0000","last_unstale":"2024-04-26T21:37:23.008565+0000","last_undegraded":"2024-04-26T21:37:23.008565+0000","last_fullsized":"2024-04-26T21:37:23.008565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835302+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T21:37:22.835302+0000","last_peered":"2024-04-26T21:37:22.835302+0000","last_clean":"2024-04-26T21:37:22.835302+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T21:37:22.835302+0000","last_undegraded":"2024-04-26T21:37:22.835302+0000","last_fullsized":"2024-04-26T21:37:22.835302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504365+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T21:37:22.504365+0000","last_peered":"2024-04-26T21:37:22.504365+0000","last_clean":"2024-04-26T21:37:22.504365+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T21:37:22.504365+0000","last_undegraded":"2024-04-26T21:37:22.504365+0000","last_fullsized":"2024-04-26T21:37:22.504365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006075+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T21:37:23.006075+0000","last_peered":"2024-04-26T21:37:23.006075+0000","last_clean":"2024-04-26T21:37:23.006075+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T21:37:23.006075+0000","last_undegraded":"2024-04-26T21:37:23.006075+0000","last_fullsized":"2024-04-26T21:37:23.006075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007177+0000","last_change":"2024-04-26T21:37:16.434513+0000","last_active":"2024-04-26T21:37:23.007177+0000","last_peered":"2024-04-26T21:37:23.007177+0000","last_clean":"2024-04-26T21:37:23.007177+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T21:37:23.007177+0000","last_undegraded":"2024-04-26T21:37:23.007177+0000","last_fullsized":"2024-04-26T21:37:23.007177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835847+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T21:37:22.835847+0000","last_peered":"2024-04-26T21:37:22.835847+0000","last_clean":"2024-04-26T21:37:22.835847+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T21:37:22.835847+0000","last_undegraded":"2024-04-26T21:37:22.835847+0000","last_fullsized":"2024-04-26T21:37:22.835847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008689+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T21:37:23.008689+0000","last_peered":"2024-04-26T21:37:23.008689+0000","last_clean":"2024-04-26T21:37:23.008689+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T21:37:23.008689+0000","last_undegraded":"2024-04-26T21:37:23.008689+0000","last_fullsized":"2024-04-26T21:37:23.008689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:36.570146+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T21:37:36.570146+0000","last_peered":"2024-04-26T21:37:36.570146+0000","last_clean":"2024-04-26T21:37:36.570146+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T21:37:36.570146+0000","last_undegraded":"2024-04-26T21:37:36.570146+0000","last_fullsized":"2024-04-26T21:37:36.570146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008785+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T21:37:23.008785+0000","last_peered":"2024-04-26T21:37:23.008785+0000","last_clean":"2024-04-26T21:37:23.008785+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T21:37:23.008785+0000","last_undegraded":"2024-04-26T21:37:23.008785+0000","last_fullsized":"2024-04-26T21:37:23.008785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898450+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T21:37:22.898450+0000","last_peered":"2024-04-26T21:37:22.898450+0000","last_clean":"2024-04-26T21:37:22.898450+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T21:37:22.898450+0000","last_undegraded":"2024-04-26T21:37:22.898450+0000","last_fullsized":"2024-04-26T21:37:22.898450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009035+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T21:37:23.009035+0000","last_peered":"2024-04-26T21:37:23.009035+0000","last_clean":"2024-04-26T21:37:23.009035+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T21:37:23.009035+0000","last_undegraded":"2024-04-26T21:37:23.009035+0000","last_fullsized":"2024-04-26T21:37:23.009035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898445+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T21:37:22.898445+0000","last_peered":"2024-04-26T21:37:22.898445+0000","last_clean":"2024-04-26T21:37:22.898445+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T21:37:22.898445+0000","last_undegraded":"2024-04-26T21:37:22.898445+0000","last_fullsized":"2024-04-26T21:37:22.898445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007383+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T21:37:23.007383+0000","last_peered":"2024-04-26T21:37:23.007383+0000","last_clean":"2024-04-26T21:37:23.007383+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T21:37:23.007383+0000","last_undegraded":"2024-04-26T21:37:23.007383+0000","last_fullsized":"2024-04-26T21:37:23.007383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835976+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T21:37:22.835976+0000","last_peered":"2024-04-26T21:37:22.835976+0000","last_clean":"2024-04-26T21:37:22.835976+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T21:37:22.835976+0000","last_undegraded":"2024-04-26T21:37:22.835976+0000","last_fullsized":"2024-04-26T21:37:22.835976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504073+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T21:37:22.504073+0000","last_peered":"2024-04-26T21:37:22.504073+0000","last_clean":"2024-04-26T21:37:22.504073+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T21:37:22.504073+0000","last_undegraded":"2024-04-26T21:37:22.504073+0000","last_fullsized":"2024-04-26T21:37:22.504073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835637+0000","last_change":"2024-04-26T21:37:17.448137+0000","last_active":"2024-04-26T21:37:22.835637+0000","last_peered":"2024-04-26T21:37:22.835637+0000","last_clean":"2024-04-26T21:37:22.835637+0000","last_became_active":"2024-04-26T21:37:17.447536+0000","last_became_peered":"2024-04-26T21:37:17.447536+0000","last_unstale":"2024-04-26T21:37:22.835637+0000","last_undegraded":"2024-04-26T21:37:22.835637+0000","last_fullsized":"2024-04-26T21:37:22.835637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505128+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T21:37:22.505128+0000","last_peered":"2024-04-26T21:37:22.505128+0000","last_clean":"2024-04-26T21:37:22.505128+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T21:37:22.505128+0000","last_undegraded":"2024-04-26T21:37:22.505128+0000","last_fullsized":"2024-04-26T21:37:22.505128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502604+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T21:37:22.502604+0000","last_peered":"2024-04-26T21:37:22.502604+0000","last_clean":"2024-04-26T21:37:22.502604+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T21:37:22.502604+0000","last_undegraded":"2024-04-26T21:37:22.502604+0000","last_fullsized":"2024-04-26T21:37:22.502604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006466+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T21:37:23.006466+0000","last_peered":"2024-04-26T21:37:23.006466+0000","last_clean":"2024-04-26T21:37:23.006466+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T21:37:23.006466+0000","last_undegraded":"2024-04-26T21:37:23.006466+0000","last_fullsized":"2024-04-26T21:37:23.006466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007668+0000","last_change":"2024-04-26T21:37:17.435754+0000","last_active":"2024-04-26T21:37:23.007668+0000","last_peered":"2024-04-26T21:37:23.007668+0000","last_clean":"2024-04-26T21:37:23.007668+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T21:37:23.007668+0000","last_undegraded":"2024-04-26T21:37:23.007668+0000","last_fullsized":"2024-04-26T21:37:23.007668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834917+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T21:37:22.834917+0000","last_peered":"2024-04-26T21:37:22.834917+0000","last_clean":"2024-04-26T21:37:22.834917+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T21:37:22.834917+0000","last_undegraded":"2024-04-26T21:37:22.834917+0000","last_fullsized":"2024-04-26T21:37:22.834917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504808+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T21:37:22.504808+0000","last_peered":"2024-04-26T21:37:22.504808+0000","last_clean":"2024-04-26T21:37:22.504808+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T21:37:22.504808+0000","last_undegraded":"2024-04-26T21:37:22.504808+0000","last_fullsized":"2024-04-26T21:37:22.504808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502117+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T21:37:22.502117+0000","last_peered":"2024-04-26T21:37:22.502117+0000","last_clean":"2024-04-26T21:37:22.502117+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T21:37:22.502117+0000","last_undegraded":"2024-04-26T21:37:22.502117+0000","last_fullsized":"2024-04-26T21:37:22.502117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502975+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T21:37:22.502975+0000","last_peered":"2024-04-26T21:37:22.502975+0000","last_clean":"2024-04-26T21:37:22.502975+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T21:37:22.502975+0000","last_undegraded":"2024-04-26T21:37:22.502975+0000","last_fullsized":"2024-04-26T21:37:22.502975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504177+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T21:37:22.504177+0000","last_peered":"2024-04-26T21:37:22.504177+0000","last_clean":"2024-04-26T21:37:22.504177+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T21:37:22.504177+0000","last_undegraded":"2024-04-26T21:37:22.504177+0000","last_fullsized":"2024-04-26T21:37:22.504177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007162+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T21:37:23.007162+0000","last_peered":"2024-04-26T21:37:23.007162+0000","last_clean":"2024-04-26T21:37:23.007162+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T21:37:23.007162+0000","last_undegraded":"2024-04-26T21:37:23.007162+0000","last_fullsized":"2024-04-26T21:37:23.007162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506111+0000","last_change":"2024-04-26T21:37:21.495110+0000","last_active":"2024-04-26T21:37:22.506111+0000","last_peered":"2024-04-26T21:37:22.506111+0000","last_clean":"2024-04-26T21:37:22.506111+0000","last_became_active":"2024-04-26T21:37:21.494575+0000","last_became_peered":"2024-04-26T21:37:21.494575+0000","last_unstale":"2024-04-26T21:37:22.506111+0000","last_undegraded":"2024-04-26T21:37:22.506111+0000","last_fullsized":"2024-04-26T21:37:22.506111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:07.156560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503336+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T21:37:22.503336+0000","last_peered":"2024-04-26T21:37:22.503336+0000","last_clean":"2024-04-26T21:37:22.503336+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T21:37:22.503336+0000","last_undegraded":"2024-04-26T21:37:22.503336+0000","last_fullsized":"2024-04-26T21:37:22.503336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897778+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T21:37:22.897778+0000","last_peered":"2024-04-26T21:37:22.897778+0000","last_clean":"2024-04-26T21:37:22.897778+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T21:37:22.897778+0000","last_undegraded":"2024-04-26T21:37:22.897778+0000","last_fullsized":"2024-04-26T21:37:22.897778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503622+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T21:37:22.503622+0000","last_peered":"2024-04-26T21:37:22.503622+0000","last_clean":"2024-04-26T21:37:22.503622+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T21:37:22.503622+0000","last_undegraded":"2024-04-26T21:37:22.503622+0000","last_fullsized":"2024-04-26T21:37:22.503622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503665+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T21:37:22.503665+0000","last_peered":"2024-04-26T21:37:22.503665+0000","last_clean":"2024-04-26T21:37:22.503665+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T21:37:22.503665+0000","last_undegraded":"2024-04-26T21:37:22.503665+0000","last_fullsized":"2024-04-26T21:37:22.503665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505009+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T21:37:22.505009+0000","last_peered":"2024-04-26T21:37:22.505009+0000","last_clean":"2024-04-26T21:37:22.505009+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T21:37:22.505009+0000","last_undegraded":"2024-04-26T21:37:22.505009+0000","last_fullsized":"2024-04-26T21:37:22.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:06.431151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835356+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T21:37:22.835356+0000","last_peered":"2024-04-26T21:37:22.835356+0000","last_clean":"2024-04-26T21:37:22.835356+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T21:37:22.835356+0000","last_undegraded":"2024-04-26T21:37:22.835356+0000","last_fullsized":"2024-04-26T21:37:22.835356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006871+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T21:37:23.006871+0000","last_peered":"2024-04-26T21:37:23.006871+0000","last_clean":"2024-04-26T21:37:23.006871+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T21:37:23.006871+0000","last_undegraded":"2024-04-26T21:37:23.006871+0000","last_fullsized":"2024-04-26T21:37:23.006871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504606+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T21:37:22.504606+0000","last_peered":"2024-04-26T21:37:22.504606+0000","last_clean":"2024-04-26T21:37:22.504606+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T21:37:22.504606+0000","last_undegraded":"2024-04-26T21:37:22.504606+0000","last_fullsized":"2024-04-26T21:37:22.504606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008708+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T21:37:23.008708+0000","last_peered":"2024-04-26T21:37:23.008708+0000","last_clean":"2024-04-26T21:37:23.008708+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T21:37:23.008708+0000","last_undegraded":"2024-04-26T21:37:23.008708+0000","last_fullsized":"2024-04-26T21:37:23.008708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505315+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T21:37:22.505315+0000","last_peered":"2024-04-26T21:37:22.505315+0000","last_clean":"2024-04-26T21:37:22.505315+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T21:37:22.505315+0000","last_undegraded":"2024-04-26T21:37:22.505315+0000","last_fullsized":"2024-04-26T21:37:22.505315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503899+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T21:37:22.503899+0000","last_peered":"2024-04-26T21:37:22.503899+0000","last_clean":"2024-04-26T21:37:22.503899+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T21:37:22.503899+0000","last_undegraded":"2024-04-26T21:37:22.503899+0000","last_fullsized":"2024-04-26T21:37:22.503899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834911+0000","last_change":"2024-04-26T21:37:17.444705+0000","last_active":"2024-04-26T21:37:22.834911+0000","last_peered":"2024-04-26T21:37:22.834911+0000","last_clean":"2024-04-26T21:37:22.834911+0000","last_became_active":"2024-04-26T21:37:17.443677+0000","last_became_peered":"2024-04-26T21:37:17.443677+0000","last_unstale":"2024-04-26T21:37:22.834911+0000","last_undegraded":"2024-04-26T21:37:22.834911+0000","last_fullsized":"2024-04-26T21:37:22.834911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502478+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T21:37:22.502478+0000","last_peered":"2024-04-26T21:37:22.502478+0000","last_clean":"2024-04-26T21:37:22.502478+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T21:37:22.502478+0000","last_undegraded":"2024-04-26T21:37:22.502478+0000","last_fullsized":"2024-04-26T21:37:22.502478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834945+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T21:37:22.834945+0000","last_peered":"2024-04-26T21:37:22.834945+0000","last_clean":"2024-04-26T21:37:22.834945+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T21:37:22.834945+0000","last_undegraded":"2024-04-26T21:37:22.834945+0000","last_fullsized":"2024-04-26T21:37:22.834945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006311+0000","last_change":"2024-04-26T21:37:17.439778+0000","last_active":"2024-04-26T21:37:23.006311+0000","last_peered":"2024-04-26T21:37:23.006311+0000","last_clean":"2024-04-26T21:37:23.006311+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T21:37:23.006311+0000","last_undegraded":"2024-04-26T21:37:23.006311+0000","last_fullsized":"2024-04-26T21:37:23.006311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505241+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T21:37:22.505241+0000","last_peered":"2024-04-26T21:37:22.505241+0000","last_clean":"2024-04-26T21:37:22.505241+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T21:37:22.505241+0000","last_undegraded":"2024-04-26T21:37:22.505241+0000","last_fullsized":"2024-04-26T21:37:22.505241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009389+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T21:37:23.009389+0000","last_peered":"2024-04-26T21:37:23.009389+0000","last_clean":"2024-04-26T21:37:23.009389+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T21:37:23.009389+0000","last_undegraded":"2024-04-26T21:37:23.009389+0000","last_fullsized":"2024-04-26T21:37:23.009389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506334+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T21:37:22.506334+0000","last_peered":"2024-04-26T21:37:22.506334+0000","last_clean":"2024-04-26T21:37:22.506334+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T21:37:22.506334+0000","last_undegraded":"2024-04-26T21:37:22.506334+0000","last_fullsized":"2024-04-26T21:37:22.506334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:34.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836379+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T21:37:22.836379+0000","last_peered":"2024-04-26T21:37:22.836379+0000","last_clean":"2024-04-26T21:37:22.836379+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T21:37:22.836379+0000","last_undegraded":"2024-04-26T21:37:22.836379+0000","last_fullsized":"2024-04-26T21:37:22.836379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834542+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T21:37:22.834542+0000","last_peered":"2024-04-26T21:37:22.834542+0000","last_clean":"2024-04-26T21:37:22.834542+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T21:37:22.834542+0000","last_undegraded":"2024-04-26T21:37:22.834542+0000","last_fullsized":"2024-04-26T21:37:22.834542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007729+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T21:37:23.007729+0000","last_peered":"2024-04-26T21:37:23.007729+0000","last_clean":"2024-04-26T21:37:23.007729+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T21:37:23.007729+0000","last_undegraded":"2024-04-26T21:37:23.007729+0000","last_fullsized":"2024-04-26T21:37:23.007729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005927+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T21:37:23.005927+0000","last_peered":"2024-04-26T21:37:23.005927+0000","last_clean":"2024-04-26T21:37:23.005927+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T21:37:23.005927+0000","last_undegraded":"2024-04-26T21:37:23.005927+0000","last_fullsized":"2024-04-26T21:37:23.005927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:38.335510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502794+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T21:37:22.502794+0000","last_peered":"2024-04-26T21:37:22.502794+0000","last_clean":"2024-04-26T21:37:22.502794+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T21:37:22.502794+0000","last_undegraded":"2024-04-26T21:37:22.502794+0000","last_fullsized":"2024-04-26T21:37:22.502794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898187+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T21:37:22.898187+0000","last_peered":"2024-04-26T21:37:22.898187+0000","last_clean":"2024-04-26T21:37:22.898187+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T21:37:22.898187+0000","last_undegraded":"2024-04-26T21:37:22.898187+0000","last_fullsized":"2024-04-26T21:37:22.898187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504907+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T21:37:22.504907+0000","last_peered":"2024-04-26T21:37:22.504907+0000","last_clean":"2024-04-26T21:37:22.504907+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T21:37:22.504907+0000","last_undegraded":"2024-04-26T21:37:22.504907+0000","last_fullsized":"2024-04-26T21:37:22.504907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505211+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T21:37:22.505211+0000","last_peered":"2024-04-26T21:37:22.505211+0000","last_clean":"2024-04-26T21:37:22.505211+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T21:37:22.505211+0000","last_undegraded":"2024-04-26T21:37:22.505211+0000","last_fullsized":"2024-04-26T21:37:22.505211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009791+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T21:37:23.009791+0000","last_peered":"2024-04-26T21:37:23.009791+0000","last_clean":"2024-04-26T21:37:23.009791+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T21:37:23.009791+0000","last_undegraded":"2024-04-26T21:37:23.009791+0000","last_fullsized":"2024-04-26T21:37:23.009791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501800+0000","last_change":"2024-04-26T21:37:17.446605+0000","last_active":"2024-04-26T21:37:22.501800+0000","last_peered":"2024-04-26T21:37:22.501800+0000","last_clean":"2024-04-26T21:37:22.501800+0000","last_became_active":"2024-04-26T21:37:17.446226+0000","last_became_peered":"2024-04-26T21:37:17.446226+0000","last_unstale":"2024-04-26T21:37:22.501800+0000","last_undegraded":"2024-04-26T21:37:22.501800+0000","last_fullsized":"2024-04-26T21:37:22.501800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007819+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T21:37:23.007819+0000","last_peered":"2024-04-26T21:37:23.007819+0000","last_clean":"2024-04-26T21:37:23.007819+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T21:37:23.007819+0000","last_undegraded":"2024-04-26T21:37:23.007819+0000","last_fullsized":"2024-04-26T21:37:23.007819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834855+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T21:37:22.834855+0000","last_peered":"2024-04-26T21:37:22.834855+0000","last_clean":"2024-04-26T21:37:22.834855+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T21:37:22.834855+0000","last_undegraded":"2024-04-26T21:37:22.834855+0000","last_fullsized":"2024-04-26T21:37:22.834855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008305+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T21:37:23.008305+0000","last_peered":"2024-04-26T21:37:23.008305+0000","last_clean":"2024-04-26T21:37:23.008305+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T21:37:23.008305+0000","last_undegraded":"2024-04-26T21:37:23.008305+0000","last_fullsized":"2024-04-26T21:37:23.008305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835990+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T21:37:22.835990+0000","last_peered":"2024-04-26T21:37:22.835990+0000","last_clean":"2024-04-26T21:37:22.835990+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T21:37:22.835990+0000","last_undegraded":"2024-04-26T21:37:22.835990+0000","last_fullsized":"2024-04-26T21:37:22.835990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006647+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T21:37:23.006647+0000","last_peered":"2024-04-26T21:37:23.006647+0000","last_clean":"2024-04-26T21:37:23.006647+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T21:37:23.006647+0000","last_undegraded":"2024-04-26T21:37:23.006647+0000","last_fullsized":"2024-04-26T21:37:23.006647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009135+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T21:37:23.009135+0000","last_peered":"2024-04-26T21:37:23.009135+0000","last_clean":"2024-04-26T21:37:23.009135+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T21:37:23.009135+0000","last_undegraded":"2024-04-26T21:37:23.009135+0000","last_fullsized":"2024-04-26T21:37:23.009135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009638+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T21:37:23.009638+0000","last_peered":"2024-04-26T21:37:23.009638+0000","last_clean":"2024-04-26T21:37:23.009638+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T21:37:23.009638+0000","last_undegraded":"2024-04-26T21:37:23.009638+0000","last_fullsized":"2024-04-26T21:37:23.009638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:37:46.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:37:46.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.730+0000 7f87c7e00640 1 Processor -- start 2024-04-26T21:37:46.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.731+0000 7f87c7e00640 1 -- start start 2024-04-26T21:37:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c80b3300 0x7f87c8073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87c80b4dd0 0x7f87c8073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c7e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c814c1a0 con 0x7f87c814bdc0 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c7e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f87c814ca10 con 0x7f87c80b4dd0 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f87c8074010 con 0x7f87c80b3300 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c6a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f87c814bdc0 0x7f87c80b46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53032/0 (socket says 172.21.15.5:53032) 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c6a00640 1 -- 172.21.15.5:0/3870871699 learned_addr learned my addr 172.21.15.5:0/3870871699 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.732+0000 7f87c7400640 1 --2- 172.21.15.5:0/3870871699 >> v2:172.21.15.5:3300/0 conn(0x7f87c80b4dd0 0x7f87c8073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.733+0000 7f87bfe00640 1 --2- 172.21.15.5:0/3870871699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c80b3300 0x7f87c8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.733+0000 7f87c6000640 1 -- 172.21.15.5:0/3870871699 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233640439 0 0) 0x7f87c814c1a0 con 0x7f87c814bdc0 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.733+0000 7f87c6000640 1 -- 172.21.15.5:0/3870871699 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87ac003520 con 0x7f87c814bdc0 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.733+0000 7f87c7400640 1 -- 172.21.15.5:0/3870871699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c80b3300 msgr2=0x7f87c8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.733+0000 7f87c7400640 1 --2- 172.21.15.5:0/3870871699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c80b3300 0x7f87c8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.733+0000 7f87c7400640 1 -- 172.21.15.5:0/3870871699 >> v1:172.21.15.5:6789/0 conn(0x7f87c814bdc0 legacy=0x7f87c80b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.733+0000 7f87c7400640 1 -- 172.21.15.5:0/3870871699 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c80aea20 con 0x7f87c80b4dd0 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.734+0000 7f87c7400640 1 --2- 172.21.15.5:0/3870871699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c8073ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009d90 tx=0x7f87c002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aa509b4c7eaa80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.734+0000 7f87c6000640 1 -- 172.21.15.5:0/3870871699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0031600 con 0x7f87c80b4dd0 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.734+0000 7f87c6000640 1 -- 172.21.15.5:0/3870871699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c00317a0 con 0x7f87c80b4dd0 2024-04-26T21:37:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.734+0000 7f87c6000640 1 -- 172.21.15.5:0/3870871699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0031b70 con 0x7f87c80b4dd0 2024-04-26T21:37:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 -- 172.21.15.5:0/3870871699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 msgr2=0x7f87c8073ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 --2- 172.21.15.5:0/3870871699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c8073ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009d90 tx=0x7f87c002a5d0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 -- 172.21.15.5:0/3870871699 shutdown_connections 2024-04-26T21:37:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 --2- 172.21.15.5:0/3870871699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c8073ad0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 --2- 172.21.15.5:0/3870871699 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c80b3300 0x7f87c8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 -- 172.21.15.5:0/3870871699 >> 172.21.15.5:0/3870871699 conn(0x7f87c806c300 msgr2=0x7f87c806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 -- 172.21.15.5:0/3870871699 shutdown_connections 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.735+0000 7f87c7e00640 1 -- 172.21.15.5:0/3870871699 wait complete. 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.737+0000 7f87c7e00640 1 Processor -- start 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.737+0000 7f87c7e00640 1 -- start start 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c80b3300 0x7f87c8070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c80aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c814bdc0 0x7f87c81e2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c7e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87c80afe80 con 0x7f87c80b4dd0 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f87c806ebc0 con 0x7f87c80b3300 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f87c80b0000 con 0x7f87c814bdc0 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c80aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c80aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43898/0 (socket says 172.21.15.5:43898) 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 -- 172.21.15.5:0/2692274696 learned_addr learned my addr 172.21.15.5:0/2692274696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c7400640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c814bdc0 0x7f87c81e2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87c6a00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c80b3300 0x7f87c8070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 -- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c814bdc0 msgr2=0x7f87c81e2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c814bdc0 0x7f87c81e2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 -- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c80b3300 msgr2=0x7f87c8070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c80b3300 0x7f87c8070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.738+0000 7f87bfe00640 1 -- 172.21.15.5:0/2692274696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c80717c0 con 0x7f87c80b4dd0 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.739+0000 7f87c6a00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c80b3300 0x7f87c8070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.739+0000 7f87bfe00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c80aded0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f87b000e980 tx=0x7f87b000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.739+0000 7f87bea00640 1 -- 172.21.15.5:0/2692274696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0017070 con 0x7f87c80b4dd0 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.739+0000 7f87bea00640 1 -- 172.21.15.5:0/2692274696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b000ca00 con 0x7f87c80b4dd0 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.739+0000 7f87bea00640 1 -- 172.21.15.5:0/2692274696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b000cdd0 con 0x7f87c80b4dd0 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.739+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c80aa4a0 con 0x7f87c80b4dd0 2024-04-26T21:37:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.739+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c81454d0 con 0x7f87c80b4dd0 2024-04-26T21:37:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.740+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c81425d0 con 0x7f87c80b4dd0 2024-04-26T21:37:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.741+0000 7f87bea00640 1 -- 172.21.15.5:0/2692274696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87b001a070 con 0x7f87c80b4dd0 2024-04-26T21:37:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.742+0000 7f87bea00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f87a406c8f0 0x7f87a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.742+0000 7f87bea00640 1 -- 172.21.15.5:0/2692274696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f87b008bea0 con 0x7f87c80b4dd0 2024-04-26T21:37:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.743+0000 7f87c6a00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f87a406c8f0 0x7f87a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.744+0000 7f87c6a00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f87a406c8f0 0x7f87a406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005880 tx=0x7f87b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.746+0000 7f87bea00640 1 -- 172.21.15.5:0/2692274696 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f87b0059f80 con 0x7f87c80b4dd0 2024-04-26T21:37:46.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.941+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87c8075db0 con 0x7f87a406c8f0 2024-04-26T21:37:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.965+0000 7f87bea00640 1 -- 172.21.15.5:0/2692274696 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7f87c8075db0 con 0x7f87a406c8f0 2024-04-26T21:37:46.973 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T21:37:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.972+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f87a406c8f0 msgr2=0x7f87a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.972+0000 7f87c7e00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f87a406c8f0 0x7f87a406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005880 tx=0x7f87b8009040 comp rx=0 tx=0).stop 2024-04-26T21:37:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.972+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 msgr2=0x7f87c80aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.972+0000 7f87c7e00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c80aded0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f87b000e980 tx=0x7f87b000ee40 comp rx=0 tx=0).stop 2024-04-26T21:37:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 shutdown_connections 2024-04-26T21:37:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87c814bdc0 0x7f87c81e2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f87a406c8f0 0x7f87a406edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87c80b4dd0 0x7f87c80aded0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 --2- 172.21.15.5:0/2692274696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87c80b3300 0x7f87c8070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 >> 172.21.15.5:0/2692274696 conn(0x7f87c806c300 msgr2=0x7f87c81490b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 shutdown_connections 2024-04-26T21:37:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:46.973+0000 7f87c7e00640 1 -- 172.21.15.5:0/2692274696 wait complete. 2024-04-26T21:37:46.994 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T21:37:45.461437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227704,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747016,"statfs":{"total":773094113280,"available":772860944384,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":229756468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005883"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007792+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T21:37:23.007792+0000","last_peered":"2024-04-26T21:37:23.007792+0000","last_clean":"2024-04-26T21:37:23.007792+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T21:37:23.007792+0000","last_undegraded":"2024-04-26T21:37:23.007792+0000","last_fullsized":"2024-04-26T21:37:23.007792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:32.834699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504581+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T21:37:22.504581+0000","last_peered":"2024-04-26T21:37:22.504581+0000","last_clean":"2024-04-26T21:37:22.504581+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T21:37:22.504581+0000","last_undegraded":"2024-04-26T21:37:22.504581+0000","last_fullsized":"2024-04-26T21:37:22.504581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502119+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T21:37:22.502119+0000","last_peered":"2024-04-26T21:37:22.502119+0000","last_clean":"2024-04-26T21:37:22.502119+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T21:37:22.502119+0000","last_undegraded":"2024-04-26T21:37:22.502119+0000","last_fullsized":"2024-04-26T21:37:22.502119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505039+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T21:37:22.505039+0000","last_peered":"2024-04-26T21:37:22.505039+0000","last_clean":"2024-04-26T21:37:22.505039+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T21:37:22.505039+0000","last_undegraded":"2024-04-26T21:37:22.505039+0000","last_fullsized":"2024-04-26T21:37:22.505039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006872+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T21:37:23.006872+0000","last_peered":"2024-04-26T21:37:23.006872+0000","last_clean":"2024-04-26T21:37:23.006872+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T21:37:23.006872+0000","last_undegraded":"2024-04-26T21:37:23.006872+0000","last_fullsized":"2024-04-26T21:37:23.006872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897958+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T21:37:22.897958+0000","last_peered":"2024-04-26T21:37:22.897958+0000","last_clean":"2024-04-26T21:37:22.897958+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T21:37:22.897958+0000","last_undegraded":"2024-04-26T21:37:22.897958+0000","last_fullsized":"2024-04-26T21:37:22.897958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009318+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T21:37:23.009318+0000","last_peered":"2024-04-26T21:37:23.009318+0000","last_clean":"2024-04-26T21:37:23.009318+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T21:37:23.009318+0000","last_undegraded":"2024-04-26T21:37:23.009318+0000","last_fullsized":"2024-04-26T21:37:23.009318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835366+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T21:37:22.835366+0000","last_peered":"2024-04-26T21:37:22.835366+0000","last_clean":"2024-04-26T21:37:22.835366+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T21:37:22.835366+0000","last_undegraded":"2024-04-26T21:37:22.835366+0000","last_fullsized":"2024-04-26T21:37:22.835366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897760+0000","last_change":"2024-04-26T21:37:21.501976+0000","last_active":"2024-04-26T21:37:22.897760+0000","last_peered":"2024-04-26T21:37:22.897760+0000","last_clean":"2024-04-26T21:37:22.897760+0000","last_became_active":"2024-04-26T21:37:21.501426+0000","last_became_peered":"2024-04-26T21:37:21.501426+0000","last_unstale":"2024-04-26T21:37:22.897760+0000","last_undegraded":"2024-04-26T21:37:22.897760+0000","last_fullsized":"2024-04-26T21:37:22.897760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:44.895996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008636+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T21:37:23.008636+0000","last_peered":"2024-04-26T21:37:23.008636+0000","last_clean":"2024-04-26T21:37:23.008636+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T21:37:23.008636+0000","last_undegraded":"2024-04-26T21:37:23.008636+0000","last_fullsized":"2024-04-26T21:37:23.008636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835679+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T21:37:22.835679+0000","last_peered":"2024-04-26T21:37:22.835679+0000","last_clean":"2024-04-26T21:37:22.835679+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T21:37:22.835679+0000","last_undegraded":"2024-04-26T21:37:22.835679+0000","last_fullsized":"2024-04-26T21:37:22.835679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897630+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T21:37:22.897630+0000","last_peered":"2024-04-26T21:37:22.897630+0000","last_clean":"2024-04-26T21:37:22.897630+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T21:37:22.897630+0000","last_undegraded":"2024-04-26T21:37:22.897630+0000","last_fullsized":"2024-04-26T21:37:22.897630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503627+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T21:37:22.503627+0000","last_peered":"2024-04-26T21:37:22.503627+0000","last_clean":"2024-04-26T21:37:22.503627+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T21:37:22.503627+0000","last_undegraded":"2024-04-26T21:37:22.503627+0000","last_fullsized":"2024-04-26T21:37:22.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008824+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T21:37:23.008824+0000","last_peered":"2024-04-26T21:37:23.008824+0000","last_clean":"2024-04-26T21:37:23.008824+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T21:37:23.008824+0000","last_undegraded":"2024-04-26T21:37:23.008824+0000","last_fullsized":"2024-04-26T21:37:23.008824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898971+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T21:37:22.898971+0000","last_peered":"2024-04-26T21:37:22.898971+0000","last_clean":"2024-04-26T21:37:22.898971+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T21:37:22.898971+0000","last_undegraded":"2024-04-26T21:37:22.898971+0000","last_fullsized":"2024-04-26T21:37:22.898971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503070+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T21:37:22.503070+0000","last_peered":"2024-04-26T21:37:22.503070+0000","last_clean":"2024-04-26T21:37:22.503070+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T21:37:22.503070+0000","last_undegraded":"2024-04-26T21:37:22.503070+0000","last_fullsized":"2024-04-26T21:37:22.503070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008916+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T21:37:23.008916+0000","last_peered":"2024-04-26T21:37:23.008916+0000","last_clean":"2024-04-26T21:37:23.008916+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T21:37:23.008916+0000","last_undegraded":"2024-04-26T21:37:23.008916+0000","last_fullsized":"2024-04-26T21:37:23.008916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898299+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T21:37:22.898299+0000","last_peered":"2024-04-26T21:37:22.898299+0000","last_clean":"2024-04-26T21:37:22.898299+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T21:37:22.898299+0000","last_undegraded":"2024-04-26T21:37:22.898299+0000","last_fullsized":"2024-04-26T21:37:22.898299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502408+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T21:37:22.502408+0000","last_peered":"2024-04-26T21:37:22.502408+0000","last_clean":"2024-04-26T21:37:22.502408+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T21:37:22.502408+0000","last_undegraded":"2024-04-26T21:37:22.502408+0000","last_fullsized":"2024-04-26T21:37:22.502408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007771+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T21:37:23.007771+0000","last_peered":"2024-04-26T21:37:23.007771+0000","last_clean":"2024-04-26T21:37:23.007771+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T21:37:23.007771+0000","last_undegraded":"2024-04-26T21:37:23.007771+0000","last_fullsized":"2024-04-26T21:37:23.007771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009132+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T21:37:23.009132+0000","last_peered":"2024-04-26T21:37:23.009132+0000","last_clean":"2024-04-26T21:37:23.009132+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T21:37:23.009132+0000","last_undegraded":"2024-04-26T21:37:23.009132+0000","last_fullsized":"2024-04-26T21:37:23.009132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898265+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T21:37:22.898265+0000","last_peered":"2024-04-26T21:37:22.898265+0000","last_clean":"2024-04-26T21:37:22.898265+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T21:37:22.898265+0000","last_undegraded":"2024-04-26T21:37:22.898265+0000","last_fullsized":"2024-04-26T21:37:22.898265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007818+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T21:37:23.007818+0000","last_peered":"2024-04-26T21:37:23.007818+0000","last_clean":"2024-04-26T21:37:23.007818+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T21:37:23.007818+0000","last_undegraded":"2024-04-26T21:37:23.007818+0000","last_fullsized":"2024-04-26T21:37:23.007818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898858+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T21:37:22.898858+0000","last_peered":"2024-04-26T21:37:22.898858+0000","last_clean":"2024-04-26T21:37:22.898858+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T21:37:22.898858+0000","last_undegraded":"2024-04-26T21:37:22.898858+0000","last_fullsized":"2024-04-26T21:37:22.898858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007135+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T21:37:23.007135+0000","last_peered":"2024-04-26T21:37:23.007135+0000","last_clean":"2024-04-26T21:37:23.007135+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T21:37:23.007135+0000","last_undegraded":"2024-04-26T21:37:23.007135+0000","last_fullsized":"2024-04-26T21:37:23.007135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505636+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T21:37:22.505636+0000","last_peered":"2024-04-26T21:37:22.505636+0000","last_clean":"2024-04-26T21:37:22.505636+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T21:37:22.505636+0000","last_undegraded":"2024-04-26T21:37:22.505636+0000","last_fullsized":"2024-04-26T21:37:22.505636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897853+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T21:37:22.897853+0000","last_peered":"2024-04-26T21:37:22.897853+0000","last_clean":"2024-04-26T21:37:22.897853+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T21:37:22.897853+0000","last_undegraded":"2024-04-26T21:37:22.897853+0000","last_fullsized":"2024-04-26T21:37:22.897853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504219+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T21:37:22.504219+0000","last_peered":"2024-04-26T21:37:22.504219+0000","last_clean":"2024-04-26T21:37:22.504219+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T21:37:22.504219+0000","last_undegraded":"2024-04-26T21:37:22.504219+0000","last_fullsized":"2024-04-26T21:37:22.504219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009255+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T21:37:23.009255+0000","last_peered":"2024-04-26T21:37:23.009255+0000","last_clean":"2024-04-26T21:37:23.009255+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T21:37:23.009255+0000","last_undegraded":"2024-04-26T21:37:23.009255+0000","last_fullsized":"2024-04-26T21:37:23.009255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501932+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T21:37:22.501932+0000","last_peered":"2024-04-26T21:37:22.501932+0000","last_clean":"2024-04-26T21:37:22.501932+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T21:37:22.501932+0000","last_undegraded":"2024-04-26T21:37:22.501932+0000","last_fullsized":"2024-04-26T21:37:22.501932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008562+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T21:37:23.008562+0000","last_peered":"2024-04-26T21:37:23.008562+0000","last_clean":"2024-04-26T21:37:23.008562+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T21:37:23.008562+0000","last_undegraded":"2024-04-26T21:37:23.008562+0000","last_fullsized":"2024-04-26T21:37:23.008562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009625+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T21:37:23.009625+0000","last_peered":"2024-04-26T21:37:23.009625+0000","last_clean":"2024-04-26T21:37:23.009625+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T21:37:23.009625+0000","last_undegraded":"2024-04-26T21:37:23.009625+0000","last_fullsized":"2024-04-26T21:37:23.009625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006714+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T21:37:23.006714+0000","last_peered":"2024-04-26T21:37:23.006714+0000","last_clean":"2024-04-26T21:37:23.006714+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T21:37:23.006714+0000","last_undegraded":"2024-04-26T21:37:23.006714+0000","last_fullsized":"2024-04-26T21:37:23.006714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836004+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T21:37:22.836004+0000","last_peered":"2024-04-26T21:37:22.836004+0000","last_clean":"2024-04-26T21:37:22.836004+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T21:37:22.836004+0000","last_undegraded":"2024-04-26T21:37:22.836004+0000","last_fullsized":"2024-04-26T21:37:22.836004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008627+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T21:37:23.008627+0000","last_peered":"2024-04-26T21:37:23.008627+0000","last_clean":"2024-04-26T21:37:23.008627+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T21:37:23.008627+0000","last_undegraded":"2024-04-26T21:37:23.008627+0000","last_fullsized":"2024-04-26T21:37:23.008627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008859+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T21:37:23.008859+0000","last_peered":"2024-04-26T21:37:23.008859+0000","last_clean":"2024-04-26T21:37:23.008859+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T21:37:23.008859+0000","last_undegraded":"2024-04-26T21:37:23.008859+0000","last_fullsized":"2024-04-26T21:37:23.008859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898544+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T21:37:22.898544+0000","last_peered":"2024-04-26T21:37:22.898544+0000","last_clean":"2024-04-26T21:37:22.898544+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T21:37:22.898544+0000","last_undegraded":"2024-04-26T21:37:22.898544+0000","last_fullsized":"2024-04-26T21:37:22.898544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835574+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T21:37:22.835574+0000","last_peered":"2024-04-26T21:37:22.835574+0000","last_clean":"2024-04-26T21:37:22.835574+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T21:37:22.835574+0000","last_undegraded":"2024-04-26T21:37:22.835574+0000","last_fullsized":"2024-04-26T21:37:22.835574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008566+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T21:37:23.008566+0000","last_peered":"2024-04-26T21:37:23.008566+0000","last_clean":"2024-04-26T21:37:23.008566+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T21:37:23.008566+0000","last_undegraded":"2024-04-26T21:37:23.008566+0000","last_fullsized":"2024-04-26T21:37:23.008566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007854+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T21:37:23.007854+0000","last_peered":"2024-04-26T21:37:23.007854+0000","last_clean":"2024-04-26T21:37:23.007854+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T21:37:23.007854+0000","last_undegraded":"2024-04-26T21:37:23.007854+0000","last_fullsized":"2024-04-26T21:37:23.007854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505152+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T21:37:22.505152+0000","last_peered":"2024-04-26T21:37:22.505152+0000","last_clean":"2024-04-26T21:37:22.505152+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T21:37:22.505152+0000","last_undegraded":"2024-04-26T21:37:22.505152+0000","last_fullsized":"2024-04-26T21:37:22.505152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009481+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T21:37:23.009481+0000","last_peered":"2024-04-26T21:37:23.009481+0000","last_clean":"2024-04-26T21:37:23.009481+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T21:37:23.009481+0000","last_undegraded":"2024-04-26T21:37:23.009481+0000","last_fullsized":"2024-04-26T21:37:23.009481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005333+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T21:37:23.005333+0000","last_peered":"2024-04-26T21:37:23.005333+0000","last_clean":"2024-04-26T21:37:23.005333+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T21:37:23.005333+0000","last_undegraded":"2024-04-26T21:37:23.005333+0000","last_fullsized":"2024-04-26T21:37:23.005333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:03.104148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007821+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T21:37:23.007821+0000","last_peered":"2024-04-26T21:37:23.007821+0000","last_clean":"2024-04-26T21:37:23.007821+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T21:37:23.007821+0000","last_undegraded":"2024-04-26T21:37:23.007821+0000","last_fullsized":"2024-04-26T21:37:23.007821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007190+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T21:37:23.007190+0000","last_peered":"2024-04-26T21:37:23.007190+0000","last_clean":"2024-04-26T21:37:23.007190+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T21:37:23.007190+0000","last_undegraded":"2024-04-26T21:37:23.007190+0000","last_fullsized":"2024-04-26T21:37:23.007190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502972+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T21:37:22.502972+0000","last_peered":"2024-04-26T21:37:22.502972+0000","last_clean":"2024-04-26T21:37:22.502972+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T21:37:22.502972+0000","last_undegraded":"2024-04-26T21:37:22.502972+0000","last_fullsized":"2024-04-26T21:37:22.502972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835398+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T21:37:22.835398+0000","last_peered":"2024-04-26T21:37:22.835398+0000","last_clean":"2024-04-26T21:37:22.835398+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T21:37:22.835398+0000","last_undegraded":"2024-04-26T21:37:22.835398+0000","last_fullsized":"2024-04-26T21:37:22.835398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008149+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T21:37:23.008149+0000","last_peered":"2024-04-26T21:37:23.008149+0000","last_clean":"2024-04-26T21:37:23.008149+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T21:37:23.008149+0000","last_undegraded":"2024-04-26T21:37:23.008149+0000","last_fullsized":"2024-04-26T21:37:23.008149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504892+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T21:37:22.504892+0000","last_peered":"2024-04-26T21:37:22.504892+0000","last_clean":"2024-04-26T21:37:22.504892+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T21:37:22.504892+0000","last_undegraded":"2024-04-26T21:37:22.504892+0000","last_fullsized":"2024-04-26T21:37:22.504892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008990+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T21:37:23.008990+0000","last_peered":"2024-04-26T21:37:23.008990+0000","last_clean":"2024-04-26T21:37:23.008990+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T21:37:23.008990+0000","last_undegraded":"2024-04-26T21:37:23.008990+0000","last_fullsized":"2024-04-26T21:37:23.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506652+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T21:37:22.506652+0000","last_peered":"2024-04-26T21:37:22.506652+0000","last_clean":"2024-04-26T21:37:22.506652+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T21:37:22.506652+0000","last_undegraded":"2024-04-26T21:37:22.506652+0000","last_fullsized":"2024-04-26T21:37:22.506652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503917+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T21:37:22.503917+0000","last_peered":"2024-04-26T21:37:22.503917+0000","last_clean":"2024-04-26T21:37:22.503917+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T21:37:22.503917+0000","last_undegraded":"2024-04-26T21:37:22.503917+0000","last_fullsized":"2024-04-26T21:37:22.503917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835628+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T21:37:22.835628+0000","last_peered":"2024-04-26T21:37:22.835628+0000","last_clean":"2024-04-26T21:37:22.835628+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T21:37:22.835628+0000","last_undegraded":"2024-04-26T21:37:22.835628+0000","last_fullsized":"2024-04-26T21:37:22.835628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008941+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T21:37:23.008941+0000","last_peered":"2024-04-26T21:37:23.008941+0000","last_clean":"2024-04-26T21:37:23.008941+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T21:37:23.008941+0000","last_undegraded":"2024-04-26T21:37:23.008941+0000","last_fullsized":"2024-04-26T21:37:23.008941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006971+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T21:37:23.006971+0000","last_peered":"2024-04-26T21:37:23.006971+0000","last_clean":"2024-04-26T21:37:23.006971+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T21:37:23.006971+0000","last_undegraded":"2024-04-26T21:37:23.006971+0000","last_fullsized":"2024-04-26T21:37:23.006971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009805+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T21:37:23.009805+0000","last_peered":"2024-04-26T21:37:23.009805+0000","last_clean":"2024-04-26T21:37:23.009805+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T21:37:23.009805+0000","last_undegraded":"2024-04-26T21:37:23.009805+0000","last_fullsized":"2024-04-26T21:37:23.009805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506616+0000","last_change":"2024-04-26T21:37:16.418849+0000","last_active":"2024-04-26T21:37:22.506616+0000","last_peered":"2024-04-26T21:37:22.506616+0000","last_clean":"2024-04-26T21:37:22.506616+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T21:37:22.506616+0000","last_undegraded":"2024-04-26T21:37:22.506616+0000","last_fullsized":"2024-04-26T21:37:22.506616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834725+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T21:37:22.834725+0000","last_peered":"2024-04-26T21:37:22.834725+0000","last_clean":"2024-04-26T21:37:22.834725+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T21:37:22.834725+0000","last_undegraded":"2024-04-26T21:37:22.834725+0000","last_fullsized":"2024-04-26T21:37:22.834725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009172+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T21:37:23.009172+0000","last_peered":"2024-04-26T21:37:23.009172+0000","last_clean":"2024-04-26T21:37:23.009172+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T21:37:23.009172+0000","last_undegraded":"2024-04-26T21:37:23.009172+0000","last_fullsized":"2024-04-26T21:37:23.009172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.899073+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T21:37:22.899073+0000","last_peered":"2024-04-26T21:37:22.899073+0000","last_clean":"2024-04-26T21:37:22.899073+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T21:37:22.899073+0000","last_undegraded":"2024-04-26T21:37:22.899073+0000","last_fullsized":"2024-04-26T21:37:22.899073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897301+0000","last_change":"2024-04-26T21:37:21.502051+0000","last_active":"2024-04-26T21:37:22.897301+0000","last_peered":"2024-04-26T21:37:22.897301+0000","last_clean":"2024-04-26T21:37:22.897301+0000","last_became_active":"2024-04-26T21:37:21.501344+0000","last_became_peered":"2024-04-26T21:37:21.501344+0000","last_unstale":"2024-04-26T21:37:22.897301+0000","last_undegraded":"2024-04-26T21:37:22.897301+0000","last_fullsized":"2024-04-26T21:37:22.897301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:09.470569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008124+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T21:37:23.008124+0000","last_peered":"2024-04-26T21:37:23.008124+0000","last_clean":"2024-04-26T21:37:23.008124+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T21:37:23.008124+0000","last_undegraded":"2024-04-26T21:37:23.008124+0000","last_fullsized":"2024-04-26T21:37:23.008124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505059+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T21:37:22.505059+0000","last_peered":"2024-04-26T21:37:22.505059+0000","last_clean":"2024-04-26T21:37:22.505059+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T21:37:22.505059+0000","last_undegraded":"2024-04-26T21:37:22.505059+0000","last_fullsized":"2024-04-26T21:37:22.505059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007063+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T21:37:23.007063+0000","last_peered":"2024-04-26T21:37:23.007063+0000","last_clean":"2024-04-26T21:37:23.007063+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T21:37:23.007063+0000","last_undegraded":"2024-04-26T21:37:23.007063+0000","last_fullsized":"2024-04-26T21:37:23.007063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504231+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T21:37:22.504231+0000","last_peered":"2024-04-26T21:37:22.504231+0000","last_clean":"2024-04-26T21:37:22.504231+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T21:37:22.504231+0000","last_undegraded":"2024-04-26T21:37:22.504231+0000","last_fullsized":"2024-04-26T21:37:22.504231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503921+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T21:37:22.503921+0000","last_peered":"2024-04-26T21:37:22.503921+0000","last_clean":"2024-04-26T21:37:22.503921+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T21:37:22.503921+0000","last_undegraded":"2024-04-26T21:37:22.503921+0000","last_fullsized":"2024-04-26T21:37:22.503921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503817+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T21:37:22.503817+0000","last_peered":"2024-04-26T21:37:22.503817+0000","last_clean":"2024-04-26T21:37:22.503817+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T21:37:22.503817+0000","last_undegraded":"2024-04-26T21:37:22.503817+0000","last_fullsized":"2024-04-26T21:37:22.503817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008565+0000","last_change":"2024-04-26T21:37:17.449356+0000","last_active":"2024-04-26T21:37:23.008565+0000","last_peered":"2024-04-26T21:37:23.008565+0000","last_clean":"2024-04-26T21:37:23.008565+0000","last_became_active":"2024-04-26T21:37:17.449065+0000","last_became_peered":"2024-04-26T21:37:17.449065+0000","last_unstale":"2024-04-26T21:37:23.008565+0000","last_undegraded":"2024-04-26T21:37:23.008565+0000","last_fullsized":"2024-04-26T21:37:23.008565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835302+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T21:37:22.835302+0000","last_peered":"2024-04-26T21:37:22.835302+0000","last_clean":"2024-04-26T21:37:22.835302+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T21:37:22.835302+0000","last_undegraded":"2024-04-26T21:37:22.835302+0000","last_fullsized":"2024-04-26T21:37:22.835302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504365+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T21:37:22.504365+0000","last_peered":"2024-04-26T21:37:22.504365+0000","last_clean":"2024-04-26T21:37:22.504365+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T21:37:22.504365+0000","last_undegraded":"2024-04-26T21:37:22.504365+0000","last_fullsized":"2024-04-26T21:37:22.504365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006075+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T21:37:23.006075+0000","last_peered":"2024-04-26T21:37:23.006075+0000","last_clean":"2024-04-26T21:37:23.006075+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T21:37:23.006075+0000","last_undegraded":"2024-04-26T21:37:23.006075+0000","last_fullsized":"2024-04-26T21:37:23.006075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007177+0000","last_change":"2024-04-26T21:37:16.434513+0000","last_active":"2024-04-26T21:37:23.007177+0000","last_peered":"2024-04-26T21:37:23.007177+0000","last_clean":"2024-04-26T21:37:23.007177+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T21:37:23.007177+0000","last_undegraded":"2024-04-26T21:37:23.007177+0000","last_fullsized":"2024-04-26T21:37:23.007177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835847+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T21:37:22.835847+0000","last_peered":"2024-04-26T21:37:22.835847+0000","last_clean":"2024-04-26T21:37:22.835847+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T21:37:22.835847+0000","last_undegraded":"2024-04-26T21:37:22.835847+0000","last_fullsized":"2024-04-26T21:37:22.835847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008689+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T21:37:23.008689+0000","last_peered":"2024-04-26T21:37:23.008689+0000","last_clean":"2024-04-26T21:37:23.008689+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T21:37:23.008689+0000","last_undegraded":"2024-04-26T21:37:23.008689+0000","last_fullsized":"2024-04-26T21:37:23.008689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:36.570146+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T21:37:36.570146+0000","last_peered":"2024-04-26T21:37:36.570146+0000","last_clean":"2024-04-26T21:37:36.570146+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T21:37:36.570146+0000","last_undegraded":"2024-04-26T21:37:36.570146+0000","last_fullsized":"2024-04-26T21:37:36.570146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008785+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T21:37:23.008785+0000","last_peered":"2024-04-26T21:37:23.008785+0000","last_clean":"2024-04-26T21:37:23.008785+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T21:37:23.008785+0000","last_undegraded":"2024-04-26T21:37:23.008785+0000","last_fullsized":"2024-04-26T21:37:23.008785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898450+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T21:37:22.898450+0000","last_peered":"2024-04-26T21:37:22.898450+0000","last_clean":"2024-04-26T21:37:22.898450+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T21:37:22.898450+0000","last_undegraded":"2024-04-26T21:37:22.898450+0000","last_fullsized":"2024-04-26T21:37:22.898450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009035+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T21:37:23.009035+0000","last_peered":"2024-04-26T21:37:23.009035+0000","last_clean":"2024-04-26T21:37:23.009035+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T21:37:23.009035+0000","last_undegraded":"2024-04-26T21:37:23.009035+0000","last_fullsized":"2024-04-26T21:37:23.009035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898445+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T21:37:22.898445+0000","last_peered":"2024-04-26T21:37:22.898445+0000","last_clean":"2024-04-26T21:37:22.898445+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T21:37:22.898445+0000","last_undegraded":"2024-04-26T21:37:22.898445+0000","last_fullsized":"2024-04-26T21:37:22.898445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007383+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T21:37:23.007383+0000","last_peered":"2024-04-26T21:37:23.007383+0000","last_clean":"2024-04-26T21:37:23.007383+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T21:37:23.007383+0000","last_undegraded":"2024-04-26T21:37:23.007383+0000","last_fullsized":"2024-04-26T21:37:23.007383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835976+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T21:37:22.835976+0000","last_peered":"2024-04-26T21:37:22.835976+0000","last_clean":"2024-04-26T21:37:22.835976+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T21:37:22.835976+0000","last_undegraded":"2024-04-26T21:37:22.835976+0000","last_fullsized":"2024-04-26T21:37:22.835976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504073+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T21:37:22.504073+0000","last_peered":"2024-04-26T21:37:22.504073+0000","last_clean":"2024-04-26T21:37:22.504073+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T21:37:22.504073+0000","last_undegraded":"2024-04-26T21:37:22.504073+0000","last_fullsized":"2024-04-26T21:37:22.504073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835637+0000","last_change":"2024-04-26T21:37:17.448137+0000","last_active":"2024-04-26T21:37:22.835637+0000","last_peered":"2024-04-26T21:37:22.835637+0000","last_clean":"2024-04-26T21:37:22.835637+0000","last_became_active":"2024-04-26T21:37:17.447536+0000","last_became_peered":"2024-04-26T21:37:17.447536+0000","last_unstale":"2024-04-26T21:37:22.835637+0000","last_undegraded":"2024-04-26T21:37:22.835637+0000","last_fullsized":"2024-04-26T21:37:22.835637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505128+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T21:37:22.505128+0000","last_peered":"2024-04-26T21:37:22.505128+0000","last_clean":"2024-04-26T21:37:22.505128+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T21:37:22.505128+0000","last_undegraded":"2024-04-26T21:37:22.505128+0000","last_fullsized":"2024-04-26T21:37:22.505128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502604+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T21:37:22.502604+0000","last_peered":"2024-04-26T21:37:22.502604+0000","last_clean":"2024-04-26T21:37:22.502604+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T21:37:22.502604+0000","last_undegraded":"2024-04-26T21:37:22.502604+0000","last_fullsized":"2024-04-26T21:37:22.502604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006466+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T21:37:23.006466+0000","last_peered":"2024-04-26T21:37:23.006466+0000","last_clean":"2024-04-26T21:37:23.006466+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T21:37:23.006466+0000","last_undegraded":"2024-04-26T21:37:23.006466+0000","last_fullsized":"2024-04-26T21:37:23.006466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007668+0000","last_change":"2024-04-26T21:37:17.435754+0000","last_active":"2024-04-26T21:37:23.007668+0000","last_peered":"2024-04-26T21:37:23.007668+0000","last_clean":"2024-04-26T21:37:23.007668+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T21:37:23.007668+0000","last_undegraded":"2024-04-26T21:37:23.007668+0000","last_fullsized":"2024-04-26T21:37:23.007668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834917+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T21:37:22.834917+0000","last_peered":"2024-04-26T21:37:22.834917+0000","last_clean":"2024-04-26T21:37:22.834917+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T21:37:22.834917+0000","last_undegraded":"2024-04-26T21:37:22.834917+0000","last_fullsized":"2024-04-26T21:37:22.834917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504808+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T21:37:22.504808+0000","last_peered":"2024-04-26T21:37:22.504808+0000","last_clean":"2024-04-26T21:37:22.504808+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T21:37:22.504808+0000","last_undegraded":"2024-04-26T21:37:22.504808+0000","last_fullsized":"2024-04-26T21:37:22.504808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502117+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T21:37:22.502117+0000","last_peered":"2024-04-26T21:37:22.502117+0000","last_clean":"2024-04-26T21:37:22.502117+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T21:37:22.502117+0000","last_undegraded":"2024-04-26T21:37:22.502117+0000","last_fullsized":"2024-04-26T21:37:22.502117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502975+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T21:37:22.502975+0000","last_peered":"2024-04-26T21:37:22.502975+0000","last_clean":"2024-04-26T21:37:22.502975+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T21:37:22.502975+0000","last_undegraded":"2024-04-26T21:37:22.502975+0000","last_fullsized":"2024-04-26T21:37:22.502975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504177+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T21:37:22.504177+0000","last_peered":"2024-04-26T21:37:22.504177+0000","last_clean":"2024-04-26T21:37:22.504177+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T21:37:22.504177+0000","last_undegraded":"2024-04-26T21:37:22.504177+0000","last_fullsized":"2024-04-26T21:37:22.504177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007162+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T21:37:23.007162+0000","last_peered":"2024-04-26T21:37:23.007162+0000","last_clean":"2024-04-26T21:37:23.007162+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T21:37:23.007162+0000","last_undegraded":"2024-04-26T21:37:23.007162+0000","last_fullsized":"2024-04-26T21:37:23.007162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506111+0000","last_change":"2024-04-26T21:37:21.495110+0000","last_active":"2024-04-26T21:37:22.506111+0000","last_peered":"2024-04-26T21:37:22.506111+0000","last_clean":"2024-04-26T21:37:22.506111+0000","last_became_active":"2024-04-26T21:37:21.494575+0000","last_became_peered":"2024-04-26T21:37:21.494575+0000","last_unstale":"2024-04-26T21:37:22.506111+0000","last_undegraded":"2024-04-26T21:37:22.506111+0000","last_fullsized":"2024-04-26T21:37:22.506111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:07.156560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503336+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T21:37:22.503336+0000","last_peered":"2024-04-26T21:37:22.503336+0000","last_clean":"2024-04-26T21:37:22.503336+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T21:37:22.503336+0000","last_undegraded":"2024-04-26T21:37:22.503336+0000","last_fullsized":"2024-04-26T21:37:22.503336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.897778+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T21:37:22.897778+0000","last_peered":"2024-04-26T21:37:22.897778+0000","last_clean":"2024-04-26T21:37:22.897778+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T21:37:22.897778+0000","last_undegraded":"2024-04-26T21:37:22.897778+0000","last_fullsized":"2024-04-26T21:37:22.897778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503622+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T21:37:22.503622+0000","last_peered":"2024-04-26T21:37:22.503622+0000","last_clean":"2024-04-26T21:37:22.503622+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T21:37:22.503622+0000","last_undegraded":"2024-04-26T21:37:22.503622+0000","last_fullsized":"2024-04-26T21:37:22.503622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503665+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T21:37:22.503665+0000","last_peered":"2024-04-26T21:37:22.503665+0000","last_clean":"2024-04-26T21:37:22.503665+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T21:37:22.503665+0000","last_undegraded":"2024-04-26T21:37:22.503665+0000","last_fullsized":"2024-04-26T21:37:22.503665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505009+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T21:37:22.505009+0000","last_peered":"2024-04-26T21:37:22.505009+0000","last_clean":"2024-04-26T21:37:22.505009+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T21:37:22.505009+0000","last_undegraded":"2024-04-26T21:37:22.505009+0000","last_fullsized":"2024-04-26T21:37:22.505009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:06.431151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835356+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T21:37:22.835356+0000","last_peered":"2024-04-26T21:37:22.835356+0000","last_clean":"2024-04-26T21:37:22.835356+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T21:37:22.835356+0000","last_undegraded":"2024-04-26T21:37:22.835356+0000","last_fullsized":"2024-04-26T21:37:22.835356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006871+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T21:37:23.006871+0000","last_peered":"2024-04-26T21:37:23.006871+0000","last_clean":"2024-04-26T21:37:23.006871+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T21:37:23.006871+0000","last_undegraded":"2024-04-26T21:37:23.006871+0000","last_fullsized":"2024-04-26T21:37:23.006871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504606+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T21:37:22.504606+0000","last_peered":"2024-04-26T21:37:22.504606+0000","last_clean":"2024-04-26T21:37:22.504606+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T21:37:22.504606+0000","last_undegraded":"2024-04-26T21:37:22.504606+0000","last_fullsized":"2024-04-26T21:37:22.504606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008708+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T21:37:23.008708+0000","last_peered":"2024-04-26T21:37:23.008708+0000","last_clean":"2024-04-26T21:37:23.008708+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T21:37:23.008708+0000","last_undegraded":"2024-04-26T21:37:23.008708+0000","last_fullsized":"2024-04-26T21:37:23.008708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505315+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T21:37:22.505315+0000","last_peered":"2024-04-26T21:37:22.505315+0000","last_clean":"2024-04-26T21:37:22.505315+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T21:37:22.505315+0000","last_undegraded":"2024-04-26T21:37:22.505315+0000","last_fullsized":"2024-04-26T21:37:22.505315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.503899+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T21:37:22.503899+0000","last_peered":"2024-04-26T21:37:22.503899+0000","last_clean":"2024-04-26T21:37:22.503899+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T21:37:22.503899+0000","last_undegraded":"2024-04-26T21:37:22.503899+0000","last_fullsized":"2024-04-26T21:37:22.503899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834911+0000","last_change":"2024-04-26T21:37:17.444705+0000","last_active":"2024-04-26T21:37:22.834911+0000","last_peered":"2024-04-26T21:37:22.834911+0000","last_clean":"2024-04-26T21:37:22.834911+0000","last_became_active":"2024-04-26T21:37:17.443677+0000","last_became_peered":"2024-04-26T21:37:17.443677+0000","last_unstale":"2024-04-26T21:37:22.834911+0000","last_undegraded":"2024-04-26T21:37:22.834911+0000","last_fullsized":"2024-04-26T21:37:22.834911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502478+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T21:37:22.502478+0000","last_peered":"2024-04-26T21:37:22.502478+0000","last_clean":"2024-04-26T21:37:22.502478+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T21:37:22.502478+0000","last_undegraded":"2024-04-26T21:37:22.502478+0000","last_fullsized":"2024-04-26T21:37:22.502478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834945+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T21:37:22.834945+0000","last_peered":"2024-04-26T21:37:22.834945+0000","last_clean":"2024-04-26T21:37:22.834945+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T21:37:22.834945+0000","last_undegraded":"2024-04-26T21:37:22.834945+0000","last_fullsized":"2024-04-26T21:37:22.834945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006311+0000","last_change":"2024-04-26T21:37:17.439778+0000","last_active":"2024-04-26T21:37:23.006311+0000","last_peered":"2024-04-26T21:37:23.006311+0000","last_clean":"2024-04-26T21:37:23.006311+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T21:37:23.006311+0000","last_undegraded":"2024-04-26T21:37:23.006311+0000","last_fullsized":"2024-04-26T21:37:23.006311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505241+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T21:37:22.505241+0000","last_peered":"2024-04-26T21:37:22.505241+0000","last_clean":"2024-04-26T21:37:22.505241+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T21:37:22.505241+0000","last_undegraded":"2024-04-26T21:37:22.505241+0000","last_fullsized":"2024-04-26T21:37:22.505241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009389+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T21:37:23.009389+0000","last_peered":"2024-04-26T21:37:23.009389+0000","last_clean":"2024-04-26T21:37:23.009389+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T21:37:23.009389+0000","last_undegraded":"2024-04-26T21:37:23.009389+0000","last_fullsized":"2024-04-26T21:37:23.009389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.506334+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T21:37:22.506334+0000","last_peered":"2024-04-26T21:37:22.506334+0000","last_clean":"2024-04-26T21:37:22.506334+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T21:37:22.506334+0000","last_undegraded":"2024-04-26T21:37:22.506334+0000","last_fullsized":"2024-04-26T21:37:22.506334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:34.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.836379+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T21:37:22.836379+0000","last_peered":"2024-04-26T21:37:22.836379+0000","last_clean":"2024-04-26T21:37:22.836379+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T21:37:22.836379+0000","last_undegraded":"2024-04-26T21:37:22.836379+0000","last_fullsized":"2024-04-26T21:37:22.836379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834542+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T21:37:22.834542+0000","last_peered":"2024-04-26T21:37:22.834542+0000","last_clean":"2024-04-26T21:37:22.834542+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T21:37:22.834542+0000","last_undegraded":"2024-04-26T21:37:22.834542+0000","last_fullsized":"2024-04-26T21:37:22.834542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007729+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T21:37:23.007729+0000","last_peered":"2024-04-26T21:37:23.007729+0000","last_clean":"2024-04-26T21:37:23.007729+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T21:37:23.007729+0000","last_undegraded":"2024-04-26T21:37:23.007729+0000","last_fullsized":"2024-04-26T21:37:23.007729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.005927+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T21:37:23.005927+0000","last_peered":"2024-04-26T21:37:23.005927+0000","last_clean":"2024-04-26T21:37:23.005927+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T21:37:23.005927+0000","last_undegraded":"2024-04-26T21:37:23.005927+0000","last_fullsized":"2024-04-26T21:37:23.005927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:38.335510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.502794+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T21:37:22.502794+0000","last_peered":"2024-04-26T21:37:22.502794+0000","last_clean":"2024-04-26T21:37:22.502794+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T21:37:22.502794+0000","last_undegraded":"2024-04-26T21:37:22.502794+0000","last_fullsized":"2024-04-26T21:37:22.502794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.898187+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T21:37:22.898187+0000","last_peered":"2024-04-26T21:37:22.898187+0000","last_clean":"2024-04-26T21:37:22.898187+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T21:37:22.898187+0000","last_undegraded":"2024-04-26T21:37:22.898187+0000","last_fullsized":"2024-04-26T21:37:22.898187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.504907+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T21:37:22.504907+0000","last_peered":"2024-04-26T21:37:22.504907+0000","last_clean":"2024-04-26T21:37:22.504907+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T21:37:22.504907+0000","last_undegraded":"2024-04-26T21:37:22.504907+0000","last_fullsized":"2024-04-26T21:37:22.504907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.505211+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T21:37:22.505211+0000","last_peered":"2024-04-26T21:37:22.505211+0000","last_clean":"2024-04-26T21:37:22.505211+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T21:37:22.505211+0000","last_undegraded":"2024-04-26T21:37:22.505211+0000","last_fullsized":"2024-04-26T21:37:22.505211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009791+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T21:37:23.009791+0000","last_peered":"2024-04-26T21:37:23.009791+0000","last_clean":"2024-04-26T21:37:23.009791+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T21:37:23.009791+0000","last_undegraded":"2024-04-26T21:37:23.009791+0000","last_fullsized":"2024-04-26T21:37:23.009791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.501800+0000","last_change":"2024-04-26T21:37:17.446605+0000","last_active":"2024-04-26T21:37:22.501800+0000","last_peered":"2024-04-26T21:37:22.501800+0000","last_clean":"2024-04-26T21:37:22.501800+0000","last_became_active":"2024-04-26T21:37:17.446226+0000","last_became_peered":"2024-04-26T21:37:17.446226+0000","last_unstale":"2024-04-26T21:37:22.501800+0000","last_undegraded":"2024-04-26T21:37:22.501800+0000","last_fullsized":"2024-04-26T21:37:22.501800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.007819+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T21:37:23.007819+0000","last_peered":"2024-04-26T21:37:23.007819+0000","last_clean":"2024-04-26T21:37:23.007819+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T21:37:23.007819+0000","last_undegraded":"2024-04-26T21:37:23.007819+0000","last_fullsized":"2024-04-26T21:37:23.007819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.834855+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T21:37:22.834855+0000","last_peered":"2024-04-26T21:37:22.834855+0000","last_clean":"2024-04-26T21:37:22.834855+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T21:37:22.834855+0000","last_undegraded":"2024-04-26T21:37:22.834855+0000","last_fullsized":"2024-04-26T21:37:22.834855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.008305+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T21:37:23.008305+0000","last_peered":"2024-04-26T21:37:23.008305+0000","last_clean":"2024-04-26T21:37:23.008305+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T21:37:23.008305+0000","last_undegraded":"2024-04-26T21:37:23.008305+0000","last_fullsized":"2024-04-26T21:37:23.008305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:22.835990+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T21:37:22.835990+0000","last_peered":"2024-04-26T21:37:22.835990+0000","last_clean":"2024-04-26T21:37:22.835990+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T21:37:22.835990+0000","last_undegraded":"2024-04-26T21:37:22.835990+0000","last_fullsized":"2024-04-26T21:37:22.835990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.006647+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T21:37:23.006647+0000","last_peered":"2024-04-26T21:37:23.006647+0000","last_clean":"2024-04-26T21:37:23.006647+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T21:37:23.006647+0000","last_undegraded":"2024-04-26T21:37:23.006647+0000","last_fullsized":"2024-04-26T21:37:23.006647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009135+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T21:37:23.009135+0000","last_peered":"2024-04-26T21:37:23.009135+0000","last_clean":"2024-04-26T21:37:23.009135+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T21:37:23.009135+0000","last_undegraded":"2024-04-26T21:37:23.009135+0000","last_fullsized":"2024-04-26T21:37:23.009135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T21:37:23.009638+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T21:37:23.009638+0000","last_peered":"2024-04-26T21:37:23.009638+0000","last_clean":"2024-04-26T21:37:23.009638+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T21:37:23.009638+0000","last_undegraded":"2024-04-26T21:37:23.009638+0000","last_fullsized":"2024-04-26T21:37:23.009638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:37:47.000 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T21:37:47.000 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T21:37:47.000 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T21:37:47.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T21:37:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.245+0000 7f68c9a00640 1 Processor -- start 2024-04-26T21:37:47.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.245+0000 7f68c9a00640 1 -- start start 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.246+0000 7f68c9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68c40b6e60 0x7f68c413efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.246+0000 7f68c9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68c40b2f00 0x7f68c413f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.246+0000 7f68c9a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c40b7240 con 0x7f68c40b0920 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.246+0000 7f68c9a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f68c40b3690 con 0x7f68c40b6e60 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.246+0000 7f68c9a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f68c4145250 con 0x7f68c40b2f00 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.247+0000 7f68c3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68c40b6e60 0x7f68c413efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.247+0000 7f68c3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68c40b6e60 0x7f68c413efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43906/0 (socket says 172.21.15.5:43906) 2024-04-26T21:37:47.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.247+0000 7f68c3e00640 1 -- 172.21.15.5:0/943229514 learned_addr learned my addr 172.21.15.5:0/943229514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.247+0000 7f68c3e00640 1 -- 172.21.15.5:0/943229514 >> v2:172.21.15.112:3300/0 conn(0x7f68c40b2f00 msgr2=0x7f68c413f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.247+0000 7f68c3e00640 1 --2- 172.21.15.5:0/943229514 >> v2:172.21.15.112:3300/0 conn(0x7f68c40b2f00 0x7f68c413f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.247+0000 7f68c3e00640 1 -- 172.21.15.5:0/943229514 >> v1:172.21.15.5:6789/0 conn(0x7f68c40b0920 legacy=0x7f68c41456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.247+0000 7f68c3e00640 1 -- 172.21.15.5:0/943229514 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c40b33b0 con 0x7f68c40b6e60 2024-04-26T21:37:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.248+0000 7f68c3e00640 1 --2- 172.21.15.5:0/943229514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413efa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68c40b3dd0 tx=0x7f68b402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c049d40d5e34ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.249+0000 7f68c3400640 1 -- 172.21.15.5:0/943229514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4037070 con 0x7f68c40b6e60 2024-04-26T21:37:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.249+0000 7f68c3400640 1 -- 172.21.15.5:0/943229514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b4032440 con 0x7f68c40b6e60 2024-04-26T21:37:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.249+0000 7f68c3400640 1 -- 172.21.15.5:0/943229514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4032810 con 0x7f68c40b6e60 2024-04-26T21:37:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.249+0000 7f68c9a00640 1 -- 172.21.15.5:0/943229514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 msgr2=0x7f68c413efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.249+0000 7f68c9a00640 1 --2- 172.21.15.5:0/943229514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413efa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68c40b3dd0 tx=0x7f68b402a200 comp rx=0 tx=0).stop 2024-04-26T21:37:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.250+0000 7f68c9a00640 1 -- 172.21.15.5:0/943229514 shutdown_connections 2024-04-26T21:37:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.250+0000 7f68c9a00640 1 --2- 172.21.15.5:0/943229514 >> v2:172.21.15.112:3300/0 conn(0x7f68c40b2f00 0x7f68c413f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.250+0000 7f68c9a00640 1 --2- 172.21.15.5:0/943229514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413efa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.250+0000 7f68c9a00640 1 -- 172.21.15.5:0/943229514 >> 172.21.15.5:0/943229514 conn(0x7f68c40ba0f0 msgr2=0x7f68c40b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.250+0000 7f68c9a00640 1 -- 172.21.15.5:0/943229514 shutdown_connections 2024-04-26T21:37:47.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.250+0000 7f68c9a00640 1 -- 172.21.15.5:0/943229514 wait complete. 2024-04-26T21:37:47.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.251+0000 7f68c9a00640 1 Processor -- start 2024-04-26T21:37:47.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.252+0000 7f68c9a00640 1 -- start start 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.252+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40b0920 0x7f68c41e1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.252+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40b2f00 0x7f68c4140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.252+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.252+0000 7f68c9a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4145f70 con 0x7f68c40b6e60 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.252+0000 7f68c9a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4145df0 con 0x7f68c40b2f00 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.252+0000 7f68c9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f68c414fa30 con 0x7f68c40b0920 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43910/0 (socket says 172.21.15.5:43910) 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 -- 172.21.15.5:0/2258740476 learned_addr learned my addr 172.21.15.5:0/2258740476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:47.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c3e00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40b0920 0x7f68c41e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68bbe00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40b2f00 0x7f68c4140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 -- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40b0920 msgr2=0x7f68c41e1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40b0920 0x7f68c41e1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 -- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40b2f00 msgr2=0x7f68c4140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40b2f00 0x7f68c4140b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.253+0000 7f68c9000640 1 -- 172.21.15.5:0/2258740476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c4141040 con 0x7f68c40b6e60 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.254+0000 7f68c9000640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413bb40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00c730 tx=0x7f68bc00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.254+0000 7f68c0c00640 1 -- 172.21.15.5:0/2258740476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc016020 con 0x7f68c40b6e60 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.254+0000 7f68c0c00640 1 -- 172.21.15.5:0/2258740476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc006d50 con 0x7f68c40b6e60 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.254+0000 7f68c0c00640 1 -- 172.21.15.5:0/2258740476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc003bb0 con 0x7f68c40b6e60 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.254+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c413fc70 con 0x7f68c40b6e60 2024-04-26T21:37:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.254+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c4072d30 con 0x7f68c40b6e60 2024-04-26T21:37:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.255+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c4075db0 con 0x7f68c40b6e60 2024-04-26T21:37:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.256+0000 7f68c0c00640 1 -- 172.21.15.5:0/2258740476 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f68bc0050d0 con 0x7f68c40b6e60 2024-04-26T21:37:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.257+0000 7f68c0c00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f68a006c8f0 0x7f68a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.257+0000 7f68c0c00640 1 -- 172.21.15.5:0/2258740476 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f68bc08baf0 con 0x7f68c40b6e60 2024-04-26T21:37:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.258+0000 7f68c3e00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f68a006c8f0 0x7f68a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.259+0000 7f68c3e00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f68a006c8f0 0x7f68a006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68b4034000 tx=0x7f68b402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:47.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.262+0000 7f68c0c00640 1 -- 172.21.15.5:0/2258740476 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f68bc020020 con 0x7f68c40b6e60 2024-04-26T21:37:47.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.495+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68c414f060 con 0x7f68c40b6e60 2024-04-26T21:37:47.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.496+0000 7f68c0c00640 1 -- 172.21.15.5:0/2258740476 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f68bc059bd0 con 0x7f68c40b6e60 2024-04-26T21:37:47.496 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:47.496 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f68a006c8f0 msgr2=0x7f68a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f68a006c8f0 0x7f68a006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68b4034000 tx=0x7f68b402e000 comp rx=0 tx=0).stop 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 msgr2=0x7f68c413bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413bb40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00c730 tx=0x7f68bc00cb30 comp rx=0 tx=0).stop 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 shutdown_connections 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f68a006c8f0 0x7f68a006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40b6e60 0x7f68c413bb40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40b2f00 0x7f68c4140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 --2- 172.21.15.5:0/2258740476 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40b0920 0x7f68c41e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.498+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 >> 172.21.15.5:0/2258740476 conn(0x7f68c40ba0f0 msgr2=0x7f68c40b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.499+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 shutdown_connections 2024-04-26T21:37:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.499+0000 7f68c9a00640 1 -- 172.21.15.5:0/2258740476 wait complete. 2024-04-26T21:37:47.516 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T21:37:47.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.720+0000 7f0aed800640 1 Processor -- start 2024-04-26T21:37:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.720+0000 7f0aed800640 1 -- start start 2024-04-26T21:37:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.721+0000 7f0aed800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ae80b5770 0x7f0ae814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.721+0000 7f0aed800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae80b5e00 con 0x7f0ae8142b70 2024-04-26T21:37:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.721+0000 7f0aed800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae80b4bf0 con 0x7f0ae80b68f0 2024-04-26T21:37:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.721+0000 7f0aed800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae80b7e80 con 0x7f0ae80b5770 2024-04-26T21:37:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.721+0000 7f0ade000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0ae8142b70 0x7f0ae8150ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53042/0 (socket says 172.21.15.5:53042) 2024-04-26T21:37:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.722+0000 7f0ade000640 1 -- 172.21.15.5:0/3132097941 learned_addr learned my addr 172.21.15.5:0/3132097941 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.722+0000 7f0ae7400640 1 --2- 172.21.15.5:0/3132097941 >> v2:172.21.15.112:3300/0 conn(0x7f0ae80b5770 0x7f0ae814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.722+0000 7f0ae6000640 1 -- 172.21.15.5:0/3132097941 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949186415 0 0) 0x7f0ae80b5e00 con 0x7f0ae8142b70 2024-04-26T21:37:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.722+0000 7f0ae6000640 1 -- 172.21.15.5:0/3132097941 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0acc003520 con 0x7f0ae8142b70 2024-04-26T21:37:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.723+0000 7f0ae7400640 1 -- 172.21.15.5:0/3132097941 >> v1:172.21.15.112:6789/0 conn(0x7f0ae80b68f0 legacy=0x7f0ae8142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.723+0000 7f0ae7400640 1 -- 172.21.15.5:0/3132097941 >> v1:172.21.15.5:6789/0 conn(0x7f0ae8142b70 legacy=0x7f0ae8150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.723+0000 7f0ae7400640 1 -- 172.21.15.5:0/3132097941 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae80b6cd0 con 0x7f0ae80b5770 2024-04-26T21:37:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.724+0000 7f0ae7400640 1 --2- 172.21.15.5:0/3132097941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae80b5770 0x7f0ae814bb70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00097a0 tx=0x7f0ae002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c9a5339fd3484d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.724+0000 7f0ae6000640 1 -- 172.21.15.5:0/3132097941 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0037070 con 0x7f0ae80b5770 2024-04-26T21:37:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.724+0000 7f0ae6000640 1 -- 172.21.15.5:0/3132097941 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae0032440 con 0x7f0ae80b5770 2024-04-26T21:37:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.724+0000 7f0ae6000640 1 -- 172.21.15.5:0/3132097941 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00327f0 con 0x7f0ae80b5770 2024-04-26T21:37:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.725+0000 7f0aed800640 1 -- 172.21.15.5:0/3132097941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae80b5770 msgr2=0x7f0ae814bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.725+0000 7f0aed800640 1 --2- 172.21.15.5:0/3132097941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae80b5770 0x7f0ae814bb70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00097a0 tx=0x7f0ae002a1a0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.725+0000 7f0aed800640 1 -- 172.21.15.5:0/3132097941 shutdown_connections 2024-04-26T21:37:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.725+0000 7f0aed800640 1 --2- 172.21.15.5:0/3132097941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae80b5770 0x7f0ae814bb70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.725+0000 7f0aed800640 1 -- 172.21.15.5:0/3132097941 >> 172.21.15.5:0/3132097941 conn(0x7f0ae8068480 msgr2=0x7f0ae8068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.725+0000 7f0aed800640 1 -- 172.21.15.5:0/3132097941 shutdown_connections 2024-04-26T21:37:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.725+0000 7f0aed800640 1 -- 172.21.15.5:0/3132097941 wait complete. 2024-04-26T21:37:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 Processor -- start 2024-04-26T21:37:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 -- start start 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ae80b5770 0x7f0ae8144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ae80b68f0 0x7f0ae81ddf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae8142b70 0x7f0ae81de460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80bb580 con 0x7f0ae80b5770 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80bb330 con 0x7f0ae8142b70 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.727+0000 7f0aed800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae80b52e0 con 0x7f0ae80b68f0 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ae80b5770 0x7f0ae8144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ae80b5770 0x7f0ae8144c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43926/0 (socket says 172.21.15.5:43926) 2024-04-26T21:37:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 -- 172.21.15.5:0/643497662 learned_addr learned my addr 172.21.15.5:0/643497662 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ade000640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ae80b68f0 0x7f0ae81ddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae7400640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae8142b70 0x7f0ae81de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 -- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ae80b68f0 msgr2=0x7f0ae81ddf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ae80b68f0 0x7f0ae81ddf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 -- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae8142b70 msgr2=0x7f0ae81de460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae8142b70 0x7f0ae81de460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ae6a00640 1 -- 172.21.15.5:0/643497662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae81d1b50 con 0x7f0ae80b5770 2024-04-26T21:37:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.728+0000 7f0ade000640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ae80b68f0 0x7f0ae81ddf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.729+0000 7f0ae6a00640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ae80b5770 0x7f0ae8144c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c8a0 tx=0x7f0ad800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.729+0000 7f0adf400640 1 -- 172.21.15.5:0/643497662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8003b70 con 0x7f0ae80b5770 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.729+0000 7f0adf400640 1 -- 172.21.15.5:0/643497662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad8003d30 con 0x7f0ae80b5770 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.729+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae81439d0 con 0x7f0ae80b5770 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.729+0000 7f0adf400640 1 -- 172.21.15.5:0/643497662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800aa90 con 0x7f0ae80b5770 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.729+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae81d1870 con 0x7f0ae80b5770 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.730+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae81437c0 con 0x7f0ae80b5770 2024-04-26T21:37:47.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.731+0000 7f0adf400640 1 -- 172.21.15.5:0/643497662 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ad800ac30 con 0x7f0ae80b5770 2024-04-26T21:37:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.732+0000 7f0adf400640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ac406c8f0 0x7f0ac406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.732+0000 7f0adf400640 1 -- 172.21.15.5:0/643497662 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ad808be20 con 0x7f0ae80b5770 2024-04-26T21:37:47.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.733+0000 7f0ade000640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ac406c8f0 0x7f0ac406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.734+0000 7f0ade000640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ac406c8f0 0x7f0ac406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ae81e1280 tx=0x7f0ad0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.736+0000 7f0adf400640 1 -- 172.21.15.5:0/643497662 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0ad8059f00 con 0x7f0ae80b5770 2024-04-26T21:37:47.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.934+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ae8075db0 con 0x7f0ae80b5770 2024-04-26T21:37:47.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.937+0000 7f0adf400640 1 -- 172.21.15.5:0/643497662 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f0ad8059800 con 0x7f0ae80b5770 2024-04-26T21:37:47.938 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:47.938 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ac406c8f0 msgr2=0x7f0ac406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ac406c8f0 0x7f0ac406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ae81e1280 tx=0x7f0ad0009040 comp rx=0 tx=0).stop 2024-04-26T21:37:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ae80b5770 msgr2=0x7f0ae8144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:47.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ae80b5770 0x7f0ae8144c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c8a0 tx=0x7f0ad800cd60 comp rx=0 tx=0).stop 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 shutdown_connections 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ae8142b70 0x7f0ae81de460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ae80b68f0 0x7f0ae81ddf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0ac406c8f0 0x7f0ac406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 --2- 172.21.15.5:0/643497662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ae80b5770 0x7f0ae8144c90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.940+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 >> 172.21.15.5:0/643497662 conn(0x7f0ae8068480 msgr2=0x7f0ae8147aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.941+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 shutdown_connections 2024-04-26T21:37:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:47.941+0000 7f0aed800640 1 -- 172.21.15.5:0/643497662 wait complete. 2024-04-26T21:37:47.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:37:14.651248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:37:15.859697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:37:19.462053+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:37:47.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:37:48.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.166+0000 7fec21800640 1 Processor -- start 2024-04-26T21:37:48.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.167+0000 7fec21800640 1 -- start start 2024-04-26T21:37:48.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.168+0000 7fec21800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 0x7fec1c153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.168+0000 7fec21800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c073400 con 0x7fec1c0a0010 2024-04-26T21:37:48.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.168+0000 7fec21800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0b1a70 con 0x7fec1c0a03f0 2024-04-26T21:37:48.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.168+0000 7fec21800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c0736a0 con 0x7fec1c071840 2024-04-26T21:37:48.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.168+0000 7fec1aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec1c0a0010 0x7fec1c0b1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53056/0 (socket says 172.21.15.5:53056) 2024-04-26T21:37:48.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.168+0000 7fec1aa00640 1 -- 172.21.15.5:0/2887080321 learned_addr learned my addr 172.21.15.5:0/2887080321 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.168+0000 7fec1b400640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 0x7fec1c153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207472078 0 0) 0x7fec1c073400 con 0x7fec1c0a0010 2024-04-26T21:37:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec00003520 con 0x7fec1c0a0010 2024-04-26T21:37:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2744211862 0 0) 0x7fec00003520 con 0x7fec1c0a0010 2024-04-26T21:37:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 msgr2=0x7fec1c153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 0x7fec1c153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 >> v1:172.21.15.112:6789/0 conn(0x7fec1c0a03f0 legacy=0x7fec1c148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c073980 con 0x7fec1c0a0010 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fec0c001690 con 0x7fec1c0a0010 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 >> v1:172.21.15.5:6789/0 conn(0x7fec1c0a0010 legacy=0x7fec1c0b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec000039e0 0x7fec00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 0x7fec00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0736a0 con 0x7fec00004d40 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec0000baa0 con 0x7fec000039e0 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fec0000bca0 con 0x7fec1c071840 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.169+0000 7fec1b400640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.170+0000 7fec1aa00640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec000039e0 0x7fec00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.170+0000 7fec1a000640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 0x7fec00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.170+0000 7fec1b400640 1 -- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 msgr2=0x7fec00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.170+0000 7fec1b400640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c071840 0x7fec00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.170+0000 7fec1b400640 1 -- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec000039e0 msgr2=0x7fec00003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.170+0000 7fec1b400640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec000039e0 0x7fec00003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.170+0000 7fec1b400640 1 -- 172.21.15.5:0/2887080321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec00003520 con 0x7fec00004d40 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.171+0000 7fec1b400640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec000051c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fec14009f90 tx=0x7fec00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7976242090cf696 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.171+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14009c10 con 0x7fec00004d40 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.171+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec14036070 con 0x7fec00004d40 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.171+0000 7fec19600640 1 -- 172.21.15.5:0/2887080321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14031850 con 0x7fec00004d40 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.172+0000 7fec21800640 1 -- 172.21.15.5:0/2887080321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 msgr2=0x7fec000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.172+0000 7fec21800640 1 --2- 172.21.15.5:0/2887080321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec000051c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fec14009f90 tx=0x7fec00005830 comp rx=0 tx=0).stop 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.172+0000 7fec1b400640 1 -- 172.21.15.5:0/2887080321 reap_dead start 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.172+0000 7fec21800640 1 -- 172.21.15.5:0/2887080321 shutdown_connections 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.172+0000 7fec21800640 1 -- 172.21.15.5:0/2887080321 >> 172.21.15.5:0/2887080321 conn(0x7fec1c0b8bc0 msgr2=0x7fec1c0b8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.172+0000 7fec21800640 1 -- 172.21.15.5:0/2887080321 shutdown_connections 2024-04-26T21:37:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.172+0000 7fec21800640 1 -- 172.21.15.5:0/2887080321 wait complete. 2024-04-26T21:37:48.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.174+0000 7fec21800640 1 Processor -- start 2024-04-26T21:37:48.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.174+0000 7fec21800640 1 -- start start 2024-04-26T21:37:48.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec21800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec1c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec21800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c06e800 0x7fec1c145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec21800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec1c1436c0 0x7fec1c141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec21800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c148d30 con 0x7fec00004d40 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec21800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0a0da0 con 0x7fec1c1436c0 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec21800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c148eb0 con 0x7fec1c06e800 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec1c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec1c144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43930/0 (socket says 172.21.15.5:43930) 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 -- 172.21.15.5:0/4000563826 learned_addr learned my addr 172.21.15.5:0/4000563826 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1b400640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec1c1436c0 0x7fec1c141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 -- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c06e800 msgr2=0x7fec1c145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1a000640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c06e800 0x7fec1c145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c06e800 0x7fec1c145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 -- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec1c1436c0 msgr2=0x7fec1c141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec1c1436c0 0x7fec1c141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.175+0000 7fec1aa00640 1 -- 172.21.15.5:0/4000563826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c143e50 con 0x7fec00004d40 2024-04-26T21:37:48.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.176+0000 7fec1aa00640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec1c144600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e7d0 tx=0x7fec0c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.176+0000 7fec12a00640 1 -- 172.21.15.5:0/4000563826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00c8d0 con 0x7fec00004d40 2024-04-26T21:37:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.176+0000 7fec12a00640 1 -- 172.21.15.5:0/4000563826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c018070 con 0x7fec00004d40 2024-04-26T21:37:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.176+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c144c80 con 0x7fec00004d40 2024-04-26T21:37:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.176+0000 7fec12a00640 1 -- 172.21.15.5:0/4000563826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00ccd0 con 0x7fec00004d40 2024-04-26T21:37:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.176+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c143b40 con 0x7fec00004d40 2024-04-26T21:37:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.177+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1c075db0 con 0x7fec00004d40 2024-04-26T21:37:48.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.178+0000 7fec12a00640 1 -- 172.21.15.5:0/4000563826 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec0c013420 con 0x7fec00004d40 2024-04-26T21:37:48.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.179+0000 7fec12a00640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7febfc06c920 0x7febfc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.180+0000 7fec12a00640 1 -- 172.21.15.5:0/4000563826 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fec0c08ba90 con 0x7fec00004d40 2024-04-26T21:37:48.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.180+0000 7fec1a000640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7febfc06c920 0x7febfc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.182+0000 7fec1a000640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7febfc06c920 0x7febfc06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec08007fd0 tx=0x7fec08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:48.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.184+0000 7fec12a00640 1 -- 172.21.15.5:0/4000563826 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fec1c143e50 con 0x7fec00004d40 2024-04-26T21:37:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.384+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec1c143020 con 0x7fec00004d40 2024-04-26T21:37:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.386+0000 7fec12a00640 1 -- 172.21.15.5:0/4000563826 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fec0c059c10 con 0x7fec00004d40 2024-04-26T21:37:48.387 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T21:37:48.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7febfc06c920 msgr2=0x7febfc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7febfc06c920 0x7febfc06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec08007fd0 tx=0x7fec08009040 comp rx=0 tx=0).stop 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 msgr2=0x7fec1c144600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec1c144600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e7d0 tx=0x7fec0c00ec90 comp rx=0 tx=0).stop 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 shutdown_connections 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec1c1436c0 0x7fec1c141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec1c06e800 0x7fec1c145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7febfc06c920 0x7febfc06ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 --2- 172.21.15.5:0/4000563826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec00004d40 0x7fec1c144600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 >> 172.21.15.5:0/4000563826 conn(0x7fec1c0b8bc0 msgr2=0x7fec1c147840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.388+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 shutdown_connections 2024-04-26T21:37:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.389+0000 7fec21800640 1 -- 172.21.15.5:0/4000563826 wait complete. 2024-04-26T21:37:48.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:37:48.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.617+0000 7fafb0c00640 1 Processor -- start 2024-04-26T21:37:48.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.617+0000 7fafb0c00640 1 -- start start 2024-04-26T21:37:48.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.618+0000 7fafb0c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 0x7fafac0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.618+0000 7fafb0c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafac0b1ec0 con 0x7fafac0b5c40 2024-04-26T21:37:48.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.618+0000 7fafb0c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafac145470 con 0x7fafac0b6020 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.618+0000 7fafb0c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fafac0b2f80 con 0x7fafac0b1550 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafab400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fafac0b5c40 0x7fafac0b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53058/0 (socket says 172.21.15.5:53058) 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafab400640 1 -- 172.21.15.5:0/697979433 learned_addr learned my addr 172.21.15.5:0/697979433 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519664316 0 0) 0x7fafac0b1ec0 con 0x7fafac0b5c40 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf8c003520 con 0x7fafac0b5c40 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafabe00640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 0x7fafac0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633423994 0 0) 0x7faf8c003520 con 0x7fafac0b5c40 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 msgr2=0x7fafac0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 0x7fafac0b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 >> v1:172.21.15.112:6789/0 conn(0x7fafac0b6020 legacy=0x7fafac1449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac145750 con 0x7fafac0b5c40 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.619+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7faf9c001670 con 0x7fafac0b5c40 2024-04-26T21:37:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 >> v1:172.21.15.5:6789/0 conn(0x7fafac0b5c40 legacy=0x7fafac0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaa000640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0039e0 0x7faf8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaa000640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c004800 0x7faf8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaa000640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 0x7faf8c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c00bac0 con 0x7faf8c0039e0 2024-04-26T21:37:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c00de80 con 0x7faf8c004800 2024-04-26T21:37:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faf8c00e080 con 0x7fafac0b1550 2024-04-26T21:37:48.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafab400640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0039e0 0x7faf8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafaaa00640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c004800 0x7faf8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafabe00640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 0x7faf8c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafab400640 1 -- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 msgr2=0x7faf8c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafab400640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fafac0b1550 0x7faf8c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafab400640 1 -- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c004800 msgr2=0x7faf8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.620+0000 7fafab400640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf8c004800 0x7faf8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.621+0000 7fafab400640 1 -- 172.21.15.5:0/697979433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c003520 con 0x7faf8c0039e0 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.622+0000 7fafab400640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0039e0 0x7faf8c003e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c210 tx=0x7faf8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e6e7fe9b780f53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.622+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9c007d30 con 0x7faf8c0039e0 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.622+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9c005ad0 con 0x7faf8c0039e0 2024-04-26T21:37:48.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.622+0000 7fafaa000640 1 -- 172.21.15.5:0/697979433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9c007070 con 0x7faf8c0039e0 2024-04-26T21:37:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.622+0000 7fafb0c00640 1 -- 172.21.15.5:0/697979433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0039e0 msgr2=0x7faf8c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.622+0000 7fafb0c00640 1 --2- 172.21.15.5:0/697979433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf8c0039e0 0x7faf8c003e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c210 tx=0x7faf8c005830 comp rx=0 tx=0).stop 2024-04-26T21:37:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.622+0000 7fafabe00640 1 -- 172.21.15.5:0/697979433 reap_dead start 2024-04-26T21:37:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.623+0000 7fafb0c00640 1 -- 172.21.15.5:0/697979433 shutdown_connections 2024-04-26T21:37:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.623+0000 7fafb0c00640 1 -- 172.21.15.5:0/697979433 >> 172.21.15.5:0/697979433 conn(0x7fafac06c720 msgr2=0x7fafac06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.623+0000 7fafb0c00640 1 -- 172.21.15.5:0/697979433 shutdown_connections 2024-04-26T21:37:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.623+0000 7fafb0c00640 1 -- 172.21.15.5:0/697979433 wait complete. 2024-04-26T21:37:48.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.624+0000 7fafb0c00640 1 Processor -- start 2024-04-26T21:37:48.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.625+0000 7fafb0c00640 1 -- start start 2024-04-26T21:37:48.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.625+0000 7fafb0c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0039e0 0x7fafac1d1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.625+0000 7fafb0c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafac142330 0x7fafac1460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.625+0000 7fafb0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafac1465f0 0x7fafac13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.625+0000 7fafb0c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fafac145230 con 0x7fafac1465f0 2024-04-26T21:37:48.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.625+0000 7fafb0c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fafac1450b0 con 0x7fafac142330 2024-04-26T21:37:48.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.625+0000 7fafb0c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fafac0b1980 con 0x7faf8c0039e0 2024-04-26T21:37:48.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafac1465f0 0x7fafac13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafac1465f0 0x7fafac13de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43950/0 (socket says 172.21.15.5:43950) 2024-04-26T21:37:48.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 -- 172.21.15.5:0/3439981659 learned_addr learned my addr 172.21.15.5:0/3439981659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:48.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafab400640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0039e0 0x7fafac1d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafaaa00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafac142330 0x7fafac1460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 -- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0039e0 msgr2=0x7fafac1d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0039e0 0x7fafac1d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 -- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafac142330 msgr2=0x7fafac1460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafac142330 0x7fafac1460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.626+0000 7fafabe00640 1 -- 172.21.15.5:0/3439981659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac145c00 con 0x7fafac1465f0 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.627+0000 7fafabe00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafac1465f0 0x7fafac13de20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafac0b7630 tx=0x7fafa400f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.627+0000 7fafa3400640 1 -- 172.21.15.5:0/3439981659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4017020 con 0x7fafac1465f0 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.627+0000 7fafa3400640 1 -- 172.21.15.5:0/3439981659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa4004440 con 0x7fafac1465f0 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.627+0000 7fafa3400640 1 -- 172.21.15.5:0/3439981659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4003850 con 0x7fafac1465f0 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.627+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafac144410 con 0x7fafac1465f0 2024-04-26T21:37:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.627+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafac1446f0 con 0x7fafac1465f0 2024-04-26T21:37:48.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.628+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafac144220 con 0x7fafac1465f0 2024-04-26T21:37:48.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.629+0000 7fafa3400640 1 -- 172.21.15.5:0/3439981659 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafa401a020 con 0x7fafac1465f0 2024-04-26T21:37:48.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.630+0000 7fafa3400640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faf8806c8f0 0x7faf8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:48.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.630+0000 7fafa3400640 1 -- 172.21.15.5:0/3439981659 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fafa408bc60 con 0x7fafac1465f0 2024-04-26T21:37:48.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.631+0000 7fafab400640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faf8806c8f0 0x7faf8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:48.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.632+0000 7fafab400640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faf8806c8f0 0x7faf8806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faf9c033000 tx=0x7faf9c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:48.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.635+0000 7fafa3400640 1 -- 172.21.15.5:0/3439981659 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fafa4021020 con 0x7fafac1465f0 2024-04-26T21:37:48.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.841+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fafac075db0 con 0x7fafac1465f0 2024-04-26T21:37:48.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.842+0000 7fafa3400640 1 -- 172.21.15.5:0/3439981659 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fafa4059d40 con 0x7fafac1465f0 2024-04-26T21:37:48.843 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.844+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faf8806c8f0 msgr2=0x7faf8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.844+0000 7fafb0c00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faf8806c8f0 0x7faf8806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faf9c033000 tx=0x7faf9c02e000 comp rx=0 tx=0).stop 2024-04-26T21:37:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.844+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafac1465f0 msgr2=0x7fafac13de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.844+0000 7fafb0c00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafac1465f0 0x7fafac13de20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafac0b7630 tx=0x7fafa400f920 comp rx=0 tx=0).stop 2024-04-26T21:37:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 shutdown_connections 2024-04-26T21:37:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7faf8806c8f0 0x7faf8806edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafac1465f0 0x7fafac13de20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafac142330 0x7fafac1460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 --2- 172.21.15.5:0/3439981659 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf8c0039e0 0x7fafac1d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 >> 172.21.15.5:0/3439981659 conn(0x7fafac06c720 msgr2=0x7fafac0b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 shutdown_connections 2024-04-26T21:37:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:48.845+0000 7fafb0c00640 1 -- 172.21.15.5:0/3439981659 wait complete. 2024-04-26T21:37:48.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:37:49.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.080+0000 7f08c1400640 1 Processor -- start 2024-04-26T21:37:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.080+0000 7f08c1400640 1 -- start start 2024-04-26T21:37:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08c1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 0x7f08bc0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08c1400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08bc0b70c0 con 0x7f08bc0b6ce0 2024-04-26T21:37:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08c1400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08bc0b1180 con 0x7f08bc0b3080 2024-04-26T21:37:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08c1400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc0aeb80 con 0x7f08bc0afca0 2024-04-26T21:37:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08bbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08bc0b6ce0 0x7f08bc0b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53060/0 (socket says 172.21.15.5:53060) 2024-04-26T21:37:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08bbe00640 1 -- 172.21.15.5:0/261939923 learned_addr learned my addr 172.21.15.5:0/261939923 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08c0a00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 0x7f08bc0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648909158 0 0) 0x7f08bc0b70c0 con 0x7f08bc0b6ce0 2024-04-26T21:37:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.082+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08a0003520 con 0x7f08bc0b6ce0 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 501493011 0 0) 0x7f08a0003520 con 0x7f08bc0b6ce0 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 msgr2=0x7f08bc0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 0x7f08bc0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 >> v1:172.21.15.112:6789/0 conn(0x7f08bc0b3080 legacy=0x7f08bc150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc0aee60 con 0x7f08bc0b6ce0 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f08ac001670 con 0x7f08bc0b6ce0 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 >> v1:172.21.15.5:6789/0 conn(0x7f08bc0b6ce0 legacy=0x7f08bc0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 0x7f08a00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0003f60 0x7f08a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a0004d40 0x7f08a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc0aeb80 con 0x7f08a0004d40 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08a000bb50 con 0x7f08a0003f60 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f08a000bd50 con 0x7f08bc0afca0 2024-04-26T21:37:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.083+0000 7f08c0a00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a0004d40 0x7f08a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.084+0000 7f08bbe00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 0x7f08a00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.084+0000 7f08bb400640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0003f60 0x7f08a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.084+0000 7f08c0a00640 1 -- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 msgr2=0x7f08a00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.084+0000 7f08c0a00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc0afca0 0x7f08a00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.084+0000 7f08c0a00640 1 -- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0003f60 msgr2=0x7f08a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.084+0000 7f08c0a00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0003f60 0x7f08a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.084+0000 7f08c0a00640 1 -- 172.21.15.5:0/261939923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a0003520 con 0x7f08a0004d40 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.085+0000 7f08c0a00640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a0004d40 0x7f08a00051c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009fc0 tx=0x7f08a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a408d61ff022fab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.085+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4009c10 con 0x7f08a0004d40 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.085+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b4036070 con 0x7f08a0004d40 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.085+0000 7f08baa00640 1 -- 172.21.15.5:0/261939923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4031880 con 0x7f08a0004d40 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.086+0000 7f08c1400640 1 -- 172.21.15.5:0/261939923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a0004d40 msgr2=0x7f08a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.086+0000 7f08c1400640 1 --2- 172.21.15.5:0/261939923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a0004d40 0x7f08a00051c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009fc0 tx=0x7f08a0005830 comp rx=0 tx=0).stop 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.086+0000 7f08c0a00640 1 -- 172.21.15.5:0/261939923 reap_dead start 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.086+0000 7f08c1400640 1 -- 172.21.15.5:0/261939923 shutdown_connections 2024-04-26T21:37:49.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.086+0000 7f08c1400640 1 -- 172.21.15.5:0/261939923 >> 172.21.15.5:0/261939923 conn(0x7f08bc06c720 msgr2=0x7f08bc06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.086+0000 7f08c1400640 1 -- 172.21.15.5:0/261939923 shutdown_connections 2024-04-26T21:37:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.086+0000 7f08c1400640 1 -- 172.21.15.5:0/261939923 wait complete. 2024-04-26T21:37:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.088+0000 7f08c1400640 1 Processor -- start 2024-04-26T21:37:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.088+0000 7f08c1400640 1 -- start start 2024-04-26T21:37:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.088+0000 7f08c1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0004d40 0x7f08bc1e1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc124230 0x7f08bc0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08bc071920 0x7f08bc144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c1400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc0ae810 con 0x7f08bc071920 2024-04-26T21:37:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c1400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc073fe0 con 0x7f08a0004d40 2024-04-26T21:37:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c1400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc0b0640 con 0x7f08bc124230 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08bc071920 0x7f08bc144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08bc071920 0x7f08bc144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43976/0 (socket says 172.21.15.5:43976) 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 -- 172.21.15.5:0/2868356731 learned_addr learned my addr 172.21.15.5:0/2868356731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08bbe00640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0004d40 0x7f08bc1e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08bb400640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc124230 0x7f08bc0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 -- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc124230 msgr2=0x7f08bc0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc124230 0x7f08bc0713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 -- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0004d40 msgr2=0x7f08bc1e1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0004d40 0x7f08bc1e1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.089+0000 7f08c0a00640 1 -- 172.21.15.5:0/2868356731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc124760 con 0x7f08bc071920 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.090+0000 7f08c0a00640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08bc071920 0x7f08bc144db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f08b400e230 tx=0x7f08b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.090+0000 7f08b3e00640 1 -- 172.21.15.5:0/2868356731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4009c10 con 0x7f08bc071920 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.090+0000 7f08b3e00640 1 -- 172.21.15.5:0/2868356731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b4031dd0 con 0x7f08bc071920 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.090+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08bc071d80 con 0x7f08bc071920 2024-04-26T21:37:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.090+0000 7f08b3e00640 1 -- 172.21.15.5:0/2868356731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003bd0 con 0x7f08bc071920 2024-04-26T21:37:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.090+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08bc1e22a0 con 0x7f08bc071920 2024-04-26T21:37:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.091+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08bc075db0 con 0x7f08bc071920 2024-04-26T21:37:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.092+0000 7f08b3e00640 1 -- 172.21.15.5:0/2868356731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08b4005d10 con 0x7f08bc071920 2024-04-26T21:37:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.093+0000 7f08b3e00640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f089c06c970 0x7f089c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.093+0000 7f08b3e00640 1 -- 172.21.15.5:0/2868356731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f08b40ad1a0 con 0x7f08bc071920 2024-04-26T21:37:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.094+0000 7f08bbe00640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f089c06c970 0x7f089c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.095+0000 7f08bbe00640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f089c06c970 0x7f089c06ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f08ac001cc0 tx=0x7f08ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:49.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.098+0000 7f08b3e00640 1 -- 172.21.15.5:0/2868356731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f08bc124760 con 0x7f08bc071920 2024-04-26T21:37:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.312+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f08bc0b9660 con 0x7f08bc071920 2024-04-26T21:37:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.313+0000 7f08b3e00640 1 -- 172.21.15.5:0/2868356731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f08b407b300 con 0x7f08bc071920 2024-04-26T21:37:49.314 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f089c06c970 msgr2=0x7f089c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f089c06c970 0x7f089c06ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f08ac001cc0 tx=0x7f08ac009040 comp rx=0 tx=0).stop 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08bc071920 msgr2=0x7f08bc144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08bc071920 0x7f08bc144db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f08b400e230 tx=0x7f08b4009750 comp rx=0 tx=0).stop 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 shutdown_connections 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f089c06c970 0x7f089c06ee30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08bc071920 0x7f08bc144db0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08bc124230 0x7f08bc0713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 --2- 172.21.15.5:0/2868356731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08a0004d40 0x7f08bc1e1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.315+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 >> 172.21.15.5:0/2868356731 conn(0x7f08bc06c720 msgr2=0x7f08bc0b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.316+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 shutdown_connections 2024-04-26T21:37:49.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.316+0000 7f08c1400640 1 -- 172.21.15.5:0/2868356731 wait complete. 2024-04-26T21:37:49.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:37:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.545+0000 7fbfe7200640 1 Processor -- start 2024-04-26T21:37:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.545+0000 7fbfe7200640 1 -- start start 2024-04-26T21:37:49.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.546+0000 7fbfe7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe80b6770 0x7fbfe81401b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.546+0000 7fbfe7200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfe80b7040 0x7fbfe81406f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.546+0000 7fbfe7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe80b1820 con 0x7fbfe8073780 2024-04-26T21:37:49.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.546+0000 7fbfe7200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe80b63e0 con 0x7fbfe80b7040 2024-04-26T21:37:49.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.546+0000 7fbfe7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe8073b60 con 0x7fbfe80b6770 2024-04-26T21:37:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe6800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfe80b7040 0x7fbfe81406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe80b6770 0x7fbfe81401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe6800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbfe80b7040 0x7fbfe81406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54682/0 (socket says 172.21.15.5:54682) 2024-04-26T21:37:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe5400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe80b6770 0x7fbfe81401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:33116/0 (socket says 172.21.15.5:33116) 2024-04-26T21:37:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe6800640 1 -- 172.21.15.5:0/2527362460 learned_addr learned my addr 172.21.15.5:0/2527362460 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe5400640 1 -- 172.21.15.5:0/2527362460 >> v2:172.21.15.112:3300/0 conn(0x7fbfe80b7040 msgr2=0x7fbfe81406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe5400640 1 --2- 172.21.15.5:0/2527362460 >> v2:172.21.15.112:3300/0 conn(0x7fbfe80b7040 0x7fbfe81406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe5400640 1 -- 172.21.15.5:0/2527362460 >> v1:172.21.15.112:6789/0 conn(0x7fbfe8073780 legacy=0x7fbfe80b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.547+0000 7fbfe5400640 1 -- 172.21.15.5:0/2527362460 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe80b6120 con 0x7fbfe80b6770 2024-04-26T21:37:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.549+0000 7fbfe5400640 1 --2- 172.21.15.5:0/2527362460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe80b6770 0x7fbfe81401b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40097a0 tx=0x7fbfd402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90ff38aa83c8010f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.549+0000 7fbfe4a00640 1 -- 172.21.15.5:0/2527362460 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4037070 con 0x7fbfe80b6770 2024-04-26T21:37:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.549+0000 7fbfe4a00640 1 -- 172.21.15.5:0/2527362460 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd402adb0 con 0x7fbfe80b6770 2024-04-26T21:37:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.549+0000 7fbfe4a00640 1 -- 172.21.15.5:0/2527362460 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4032660 con 0x7fbfe80b6770 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 -- 172.21.15.5:0/2527362460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe80b6770 msgr2=0x7fbfe81401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 --2- 172.21.15.5:0/2527362460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe80b6770 0x7fbfe81401b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40097a0 tx=0x7fbfd402a060 comp rx=0 tx=0).stop 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 -- 172.21.15.5:0/2527362460 shutdown_connections 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 --2- 172.21.15.5:0/2527362460 >> v2:172.21.15.112:3300/0 conn(0x7fbfe80b7040 0x7fbfe81406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 --2- 172.21.15.5:0/2527362460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe80b6770 0x7fbfe81401b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 -- 172.21.15.5:0/2527362460 >> 172.21.15.5:0/2527362460 conn(0x7fbfe806d410 msgr2=0x7fbfe806d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 -- 172.21.15.5:0/2527362460 shutdown_connections 2024-04-26T21:37:49.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.550+0000 7fbfe7200640 1 -- 172.21.15.5:0/2527362460 wait complete. 2024-04-26T21:37:49.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.552+0000 7fbfe7200640 1 Processor -- start 2024-04-26T21:37:49.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.552+0000 7fbfe7200640 1 -- start start 2024-04-26T21:37:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.552+0000 7fbfe7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe8073780 0x7fbfe8072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.552+0000 7fbfe7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfe80b7040 0x7fbfe81de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe8073080 0x7fbfe81deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe80b5d00 con 0x7fbfe8073080 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe8140c30 con 0x7fbfe80b7040 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe80b5e80 con 0x7fbfe8073780 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe8073080 0x7fbfe81deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe8073080 0x7fbfe81deb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43986/0 (socket says 172.21.15.5:43986) 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 -- 172.21.15.5:0/3393610941 learned_addr learned my addr 172.21.15.5:0/3393610941 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe5e00640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe8073780 0x7fbfe8072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe5400640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfe80b7040 0x7fbfe81de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 -- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe8073780 msgr2=0x7fbfe8072b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe8073780 0x7fbfe8072b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 -- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfe80b7040 msgr2=0x7fbfe81de5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfe80b7040 0x7fbfe81de5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.553+0000 7fbfe6800640 1 -- 172.21.15.5:0/3393610941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe8072140 con 0x7fbfe8073080 2024-04-26T21:37:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.554+0000 7fbfe6800640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe8073080 0x7fbfe81deb00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000e840 tx=0x7fbfe000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.554+0000 7fbfde000640 1 -- 172.21.15.5:0/3393610941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0017070 con 0x7fbfe8073080 2024-04-26T21:37:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.554+0000 7fbfde000640 1 -- 172.21.15.5:0/3393610941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe000c730 con 0x7fbfe8073080 2024-04-26T21:37:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.554+0000 7fbfde000640 1 -- 172.21.15.5:0/3393610941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000cb00 con 0x7fbfe8073080 2024-04-26T21:37:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.554+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe80b0370 con 0x7fbfe8073080 2024-04-26T21:37:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.554+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe81de070 con 0x7fbfe8073080 2024-04-26T21:37:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.555+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe8075db0 con 0x7fbfe8073080 2024-04-26T21:37:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.556+0000 7fbfde000640 1 -- 172.21.15.5:0/3393610941 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfe001a070 con 0x7fbfe8073080 2024-04-26T21:37:49.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.557+0000 7fbfde000640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbfc806c8f0 0x7fbfc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:49.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.557+0000 7fbfde000640 1 -- 172.21.15.5:0/3393610941 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbfe008bd20 con 0x7fbfe8073080 2024-04-26T21:37:49.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.558+0000 7fbfe5e00640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbfc806c8f0 0x7fbfc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:49.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.559+0000 7fbfe5e00640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbfc806c8f0 0x7fbfc806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80012e0 tx=0x7fbfd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.562+0000 7fbfde000640 1 -- 172.21.15.5:0/3393610941 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbfe0059e00 con 0x7fbfe8073080 2024-04-26T21:37:49.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.770+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbfe80b27c0 con 0x7fbfe8073080 2024-04-26T21:37:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.771+0000 7fbfde000640 1 -- 172.21.15.5:0/3393610941 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fbfe0059700 con 0x7fbfe8073080 2024-04-26T21:37:49.772 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbfc806c8f0 msgr2=0x7fbfc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbfc806c8f0 0x7fbfc806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80012e0 tx=0x7fbfd8009040 comp rx=0 tx=0).stop 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe8073080 msgr2=0x7fbfe81deb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe8073080 0x7fbfe81deb00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000e840 tx=0x7fbfe000ed00 comp rx=0 tx=0).stop 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 shutdown_connections 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbfc806c8f0 0x7fbfc806edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe8073080 0x7fbfe81deb00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfe80b7040 0x7fbfe81de5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 --2- 172.21.15.5:0/3393610941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbfe8073780 0x7fbfe8072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.775+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 >> 172.21.15.5:0/3393610941 conn(0x7fbfe806d410 msgr2=0x7fbfe80b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.776+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 shutdown_connections 2024-04-26T21:37:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:49.776+0000 7fbfe7200640 1 -- 172.21.15.5:0/3393610941 wait complete. 2024-04-26T21:37:49.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:37:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.004+0000 7fce16e00640 1 Processor -- start 2024-04-26T21:37:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.005+0000 7fce16e00640 1 -- start start 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.006+0000 7fce16e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce100bae80 0x7fce100b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.006+0000 7fce16e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce10142310 0x7fce101427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.006+0000 7fce16e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10148600 0x7fce10148a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.006+0000 7fce16e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fce10148fd0 con 0x7fce100bae80 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.006+0000 7fce16e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fce100bb260 con 0x7fce10142310 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.006+0000 7fce16e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fce100b6270 con 0x7fce10148600 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce100bae80 0x7fce100b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce100bae80 0x7fce100b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43992/0 (socket says 172.21.15.5:43992) 2024-04-26T21:37:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 -- 172.21.15.5:0/4005961332 learned_addr learned my addr 172.21.15.5:0/4005961332 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15000640 1 --2- 172.21.15.5:0/4005961332 >> v2:172.21.15.112:3300/0 conn(0x7fce10142310 0x7fce101427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce16400640 1 --2- 172.21.15.5:0/4005961332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10148600 0x7fce10148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 -- 172.21.15.5:0/4005961332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10148600 msgr2=0x7fce10148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 --2- 172.21.15.5:0/4005961332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10148600 0x7fce10148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 -- 172.21.15.5:0/4005961332 >> v2:172.21.15.112:3300/0 conn(0x7fce10142310 msgr2=0x7fce101427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 --2- 172.21.15.5:0/4005961332 >> v2:172.21.15.112:3300/0 conn(0x7fce10142310 0x7fce101427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.007+0000 7fce15a00640 1 -- 172.21.15.5:0/4005961332 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100b6550 con 0x7fce100bae80 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.008+0000 7fce15a00640 1 --2- 172.21.15.5:0/4005961332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce100bae80 0x7fce100b57d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce100bb880 tx=0x7fce0402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef7b522154e269d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce0fe00640 1 -- 172.21.15.5:0/4005961332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04037070 con 0x7fce100bae80 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce0fe00640 1 -- 172.21.15.5:0/4005961332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04032440 con 0x7fce100bae80 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce0fe00640 1 -- 172.21.15.5:0/4005961332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04032810 con 0x7fce100bae80 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce16e00640 1 -- 172.21.15.5:0/4005961332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce100bae80 msgr2=0x7fce100b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce16e00640 1 --2- 172.21.15.5:0/4005961332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce100bae80 0x7fce100b57d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce100bb880 tx=0x7fce0402a140 comp rx=0 tx=0).stop 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce16e00640 1 -- 172.21.15.5:0/4005961332 shutdown_connections 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce16e00640 1 --2- 172.21.15.5:0/4005961332 >> v2:172.21.15.112:3300/0 conn(0x7fce10142310 0x7fce101427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce16e00640 1 --2- 172.21.15.5:0/4005961332 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10148600 0x7fce10148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.009+0000 7fce16e00640 1 --2- 172.21.15.5:0/4005961332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce100bae80 0x7fce100b57d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.010+0000 7fce16e00640 1 -- 172.21.15.5:0/4005961332 >> 172.21.15.5:0/4005961332 conn(0x7fce100684b0 msgr2=0x7fce100688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.010+0000 7fce16e00640 1 -- 172.21.15.5:0/4005961332 shutdown_connections 2024-04-26T21:37:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.010+0000 7fce16e00640 1 -- 172.21.15.5:0/4005961332 wait complete. 2024-04-26T21:37:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.011+0000 7fce16e00640 1 Processor -- start 2024-04-26T21:37:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.011+0000 7fce16e00640 1 -- start start 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce100bae80 0x7fce10149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10142310 0x7fce10147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce10148600 0x7fce101e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fce100ba310 con 0x7fce10148600 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce100ba190 con 0x7fce100bae80 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fce1014ba80 con 0x7fce10142310 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce10148600 0x7fce101e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.012+0000 7fce16400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce10148600 0x7fce101e0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44004/0 (socket says 172.21.15.5:44004) 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce16400640 1 -- 172.21.15.5:0/1883384649 learned_addr learned my addr 172.21.15.5:0/1883384649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:50.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce15a00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce100bae80 0x7fce10149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce15000640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10142310 0x7fce10147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce16400640 1 -- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10142310 msgr2=0x7fce10147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce16400640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10142310 0x7fce10147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce16400640 1 -- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce100bae80 msgr2=0x7fce10149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce16400640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce100bae80 0x7fce10149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce16400640 1 -- 172.21.15.5:0/1883384649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100bc1f0 con 0x7fce10148600 2024-04-26T21:37:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.013+0000 7fce16400640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce10148600 0x7fce101e0f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce08007e60 tx=0x7fce0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.014+0000 7fce0d600640 1 -- 172.21.15.5:0/1883384649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08014420 con 0x7fce10148600 2024-04-26T21:37:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.014+0000 7fce0d600640 1 -- 172.21.15.5:0/1883384649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce08019070 con 0x7fce10148600 2024-04-26T21:37:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.014+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce100bc4d0 con 0x7fce10148600 2024-04-26T21:37:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.014+0000 7fce0d600640 1 -- 172.21.15.5:0/1883384649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08014820 con 0x7fce10148600 2024-04-26T21:37:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.014+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce10146300 con 0x7fce10148600 2024-04-26T21:37:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.015+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce10075db0 con 0x7fce10148600 2024-04-26T21:37:50.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.016+0000 7fce0d600640 1 -- 172.21.15.5:0/1883384649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce080149c0 con 0x7fce10148600 2024-04-26T21:37:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.017+0000 7fce0d600640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcdf006c8f0 0x7fcdf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.017+0000 7fce0d600640 1 -- 172.21.15.5:0/1883384649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fce0808c720 con 0x7fce10148600 2024-04-26T21:37:50.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.018+0000 7fce15a00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcdf006c8f0 0x7fcdf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.019+0000 7fce15a00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcdf006c8f0 0x7fcdf006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce04034000 tx=0x7fce0402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.022+0000 7fce0d600640 1 -- 172.21.15.5:0/1883384649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fce0805a770 con 0x7fce10148600 2024-04-26T21:37:50.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.268+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce10140de0 con 0x7fce10148600 2024-04-26T21:37:50.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.268+0000 7fce0d600640 1 -- 172.21.15.5:0/1883384649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7fce0805a070 con 0x7fce10148600 2024-04-26T21:37:50.270 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:50.270 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:39.095752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T21:37:50.270 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-04-26T21:37:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.271+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcdf006c8f0 msgr2=0x7fcdf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.271+0000 7fce16e00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcdf006c8f0 0x7fcdf006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce04034000 tx=0x7fce0402e000 comp rx=0 tx=0).stop 2024-04-26T21:37:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.271+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce10148600 msgr2=0x7fce101e0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.271+0000 7fce16e00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce10148600 0x7fce101e0f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce08007e60 tx=0x7fce0800e4b0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.271+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 shutdown_connections 2024-04-26T21:37:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.272+0000 7fce16e00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcdf006c8f0 0x7fcdf006edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.272+0000 7fce16e00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce10148600 0x7fce101e0f70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.272+0000 7fce16e00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce10142310 0x7fce10147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.272+0000 7fce16e00640 1 --2- 172.21.15.5:0/1883384649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce100bae80 0x7fce10149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.272+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 >> 172.21.15.5:0/1883384649 conn(0x7fce100684b0 msgr2=0x7fce10141300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.272+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 shutdown_connections 2024-04-26T21:37:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.272+0000 7fce16e00640 1 -- 172.21.15.5:0/1883384649 wait complete. 2024-04-26T21:37:50.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.500+0000 7f8923200640 1 Processor -- start 2024-04-26T21:37:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.500+0000 7f8923200640 1 -- start start 2024-04-26T21:37:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.501+0000 7f8923200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f89240bae80 0x7f89240b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.501+0000 7f8923200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f89241427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.501+0000 7f8923200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89240bb260 con 0x7f8924142310 2024-04-26T21:37:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.501+0000 7f8923200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f89240b6270 con 0x7f89240bae80 2024-04-26T21:37:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.501+0000 7f8923200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f89240b6550 con 0x7f8924148d10 2024-04-26T21:37:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.502+0000 7f8922800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f89241427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.502+0000 7f8921e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f89240bae80 0x7f89240b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.502+0000 7f8922800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f89241427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:33168/0 (socket says 172.21.15.5:33168) 2024-04-26T21:37:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.502+0000 7f8922800640 1 -- 172.21.15.5:0/502064229 learned_addr learned my addr 172.21.15.5:0/502064229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.502+0000 7f8921e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f89240bae80 0x7f89240b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54712/0 (socket says 172.21.15.5:54712) 2024-04-26T21:37:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.503+0000 7f8922800640 1 -- 172.21.15.5:0/502064229 >> v2:172.21.15.112:3300/0 conn(0x7f89240bae80 msgr2=0x7f89240b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.503+0000 7f8922800640 1 --2- 172.21.15.5:0/502064229 >> v2:172.21.15.112:3300/0 conn(0x7f89240bae80 0x7f89240b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.503+0000 7f8922800640 1 -- 172.21.15.5:0/502064229 >> v1:172.21.15.112:6789/0 conn(0x7f8924142310 legacy=0x7f8924148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.503+0000 7f8922800640 1 -- 172.21.15.5:0/502064229 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89240b6830 con 0x7f8924148d10 2024-04-26T21:37:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.504+0000 7f8922800640 1 --2- 172.21.15.5:0/502064229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f89241427a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e50 tx=0x7f891c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29b39df277bf6dac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8920a00640 1 -- 172.21.15.5:0/502064229 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c036070 con 0x7f8924148d10 2024-04-26T21:37:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8920a00640 1 -- 172.21.15.5:0/502064229 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c031600 con 0x7f8924148d10 2024-04-26T21:37:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8920a00640 1 -- 172.21.15.5:0/502064229 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c0319d0 con 0x7f8924148d10 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8923200640 1 -- 172.21.15.5:0/502064229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 msgr2=0x7f89241427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8923200640 1 --2- 172.21.15.5:0/502064229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f89241427a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e50 tx=0x7f891c02a680 comp rx=0 tx=0).stop 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8923200640 1 -- 172.21.15.5:0/502064229 shutdown_connections 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8923200640 1 --2- 172.21.15.5:0/502064229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f89241427a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8923200640 1 --2- 172.21.15.5:0/502064229 >> v2:172.21.15.112:3300/0 conn(0x7f89240bae80 0x7f89240b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.505+0000 7f8923200640 1 -- 172.21.15.5:0/502064229 >> 172.21.15.5:0/502064229 conn(0x7f89240684b0 msgr2=0x7f89240688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.506+0000 7f8923200640 1 -- 172.21.15.5:0/502064229 shutdown_connections 2024-04-26T21:37:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.506+0000 7f8923200640 1 -- 172.21.15.5:0/502064229 wait complete. 2024-04-26T21:37:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.507+0000 7f8923200640 1 Processor -- start 2024-04-26T21:37:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.507+0000 7f8923200640 1 -- start start 2024-04-26T21:37:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.508+0000 7f8923200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240bae80 0x7f892413c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.508+0000 7f8923200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8924142310 0x7f89240be420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.508+0000 7f8923200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f892414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.508+0000 7f8923200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8924152f90 con 0x7f89240bae80 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.508+0000 7f8923200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8924152e10 con 0x7f8924142310 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.508+0000 7f8923200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8924153110 con 0x7f8924148d10 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240bae80 0x7f892413c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240bae80 0x7f892413c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44006/0 (socket says 172.21.15.5:44006) 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 -- 172.21.15.5:0/2158082134 learned_addr learned my addr 172.21.15.5:0/2158082134 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921400640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8924142310 0x7f89240be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8922800640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f892414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 -- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 msgr2=0x7f892414c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f892414c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 -- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8924142310 msgr2=0x7f89240be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8924142310 0x7f89240be420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.509+0000 7f8921e00640 1 -- 172.21.15.5:0/2158082134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892413da30 con 0x7f89240bae80 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.510+0000 7f8921e00640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240bae80 0x7f892413c630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f891400e9b0 tx=0x7f891400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.510+0000 7f891a000640 1 -- 172.21.15.5:0/2158082134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914017070 con 0x7f89240bae80 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.510+0000 7f891a000640 1 -- 172.21.15.5:0/2158082134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891400c9a0 con 0x7f89240bae80 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.510+0000 7f891a000640 1 -- 172.21.15.5:0/2158082134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891400cd90 con 0x7f89240bae80 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.510+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892414b940 con 0x7f89240bae80 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.510+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892414c680 con 0x7f89240bae80 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.511+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8924075db0 con 0x7f89240bae80 2024-04-26T21:37:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.512+0000 7f891a000640 1 -- 172.21.15.5:0/2158082134 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f891401a070 con 0x7f89240bae80 2024-04-26T21:37:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.514+0000 7f891a000640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f890406c8f0 0x7f890406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.514+0000 7f891a000640 1 -- 172.21.15.5:0/2158082134 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f891408c270 con 0x7f89240bae80 2024-04-26T21:37:50.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.514+0000 7f8921400640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f890406c8f0 0x7f890406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.516+0000 7f8921400640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f890406c8f0 0x7f890406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89240bec10 tx=0x7f8910009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.518+0000 7f891a000640 1 -- 172.21.15.5:0/2158082134 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f891405a350 con 0x7f89240bae80 2024-04-26T21:37:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.724+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8924149120 con 0x7f89240bae80 2024-04-26T21:37:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.726+0000 7f891a000640 1 -- 172.21.15.5:0/2158082134 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f8914059c50 con 0x7f89240bae80 2024-04-26T21:37:50.728 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:50.728 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.728+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f890406c8f0 msgr2=0x7f890406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.728+0000 7f8923200640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f890406c8f0 0x7f890406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89240bec10 tx=0x7f8910009040 comp rx=0 tx=0).stop 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.728+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240bae80 msgr2=0x7f892413c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.728+0000 7f8923200640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240bae80 0x7f892413c630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f891400e9b0 tx=0x7f891400ee70 comp rx=0 tx=0).stop 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 shutdown_connections 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8924148d10 0x7f892414c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8924142310 0x7f89240be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f890406c8f0 0x7f890406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 --2- 172.21.15.5:0/2158082134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240bae80 0x7f892413c630 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 >> 172.21.15.5:0/2158082134 conn(0x7f89240684b0 msgr2=0x7f89241406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 shutdown_connections 2024-04-26T21:37:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.729+0000 7f8923200640 1 -- 172.21.15.5:0/2158082134 wait complete. 2024-04-26T21:37:50.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:37:14.651248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:37:15.859697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:37:19.462053+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:37:50.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:37:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.953+0000 7fc071e00640 1 Processor -- start 2024-04-26T21:37:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.954+0000 7fc071e00640 1 -- start start 2024-04-26T21:37:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.955+0000 7fc071e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 0x7fc06c0ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.955+0000 7fc071e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc06c14bbd0 0x7fc06c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.955+0000 7fc071e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc06c0b7130 con 0x7fc06c0b3730 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.955+0000 7fc071e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc06c0af780 con 0x7fc06c14bbd0 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.955+0000 7fc071e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c0afa60 con 0x7fc06c0b6d50 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.955+0000 7fc06be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc06c0b3730 0x7fc06c0b3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53072/0 (socket says 172.21.15.5:53072) 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.955+0000 7fc06be00640 1 -- 172.21.15.5:0/2321720451 learned_addr learned my addr 172.21.15.5:0/2321720451 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc071400640 1 --2- 172.21.15.5:0/2321720451 >> v2:172.21.15.112:3300/0 conn(0x7fc06c14bbd0 0x7fc06c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc070a00640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 0x7fc06c0ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191694920 0 0) 0x7fc06c0b7130 con 0x7fc06c0b3730 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc054003520 con 0x7fc06c0b3730 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3784680155 0 0) 0x7fc054003520 con 0x7fc06c0b3730 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 msgr2=0x7fc06c0ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 0x7fc06c0ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 >> v2:172.21.15.112:3300/0 conn(0x7fc06c14bbd0 msgr2=0x7fc06c14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 --2- 172.21.15.5:0/2321720451 >> v2:172.21.15.112:3300/0 conn(0x7fc06c14bbd0 0x7fc06c14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c0afd40 con 0x7fc06c0b3730 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fc05c001670 con 0x7fc06c0b3730 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 >> v1:172.21.15.5:6789/0 conn(0x7fc06c0b3730 legacy=0x7fc06c0b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0540039b0 0x7fc054003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 0x7fc054004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054004d40 0x7fc0540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.956+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c0af780 con 0x7fc054004d40 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c0afa60 con 0x7fc0540039b0 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc05400b9c0 con 0x7fc06c0b6d50 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc071400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054004d40 0x7fc0540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc06be00640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 0x7fc054004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc070a00640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0540039b0 0x7fc054003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc071400640 1 -- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 msgr2=0x7fc054004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc071400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c0b6d50 0x7fc054004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc071400640 1 -- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0540039b0 msgr2=0x7fc054003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc071400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0540039b0 0x7fc054003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc071400640 1 -- 172.21.15.5:0/2321720451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc054003520 con 0x7fc054004d40 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.957+0000 7fc070a00640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0540039b0 0x7fc054003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.958+0000 7fc071400640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054004d40 0x7fc0540051c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc064009fc0 tx=0x7fc054005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0aaafb6494e223 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064009c10 con 0x7fc054004d40 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc064036070 con 0x7fc054004d40 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc06b400640 1 -- 172.21.15.5:0/2321720451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06402d070 con 0x7fc054004d40 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc071e00640 1 -- 172.21.15.5:0/2321720451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054004d40 msgr2=0x7fc0540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc071e00640 1 --2- 172.21.15.5:0/2321720451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054004d40 0x7fc0540051c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc064009fc0 tx=0x7fc054005830 comp rx=0 tx=0).stop 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc071400640 1 -- 172.21.15.5:0/2321720451 reap_dead start 2024-04-26T21:37:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc071e00640 1 -- 172.21.15.5:0/2321720451 shutdown_connections 2024-04-26T21:37:50.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc071e00640 1 -- 172.21.15.5:0/2321720451 >> 172.21.15.5:0/2321720451 conn(0x7fc06c06c720 msgr2=0x7fc06c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:50.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc071e00640 1 -- 172.21.15.5:0/2321720451 shutdown_connections 2024-04-26T21:37:50.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.959+0000 7fc071e00640 1 -- 172.21.15.5:0/2321720451 wait complete. 2024-04-26T21:37:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.961+0000 7fc071e00640 1 Processor -- start 2024-04-26T21:37:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.961+0000 7fc071e00640 1 -- start start 2024-04-26T21:37:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc071e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc054004d40 0x7fc06c139c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc071e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06c0b8280 0x7fc06c13a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc071e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c1e14e0 0x7fc06c1e1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc071e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c0ae810 con 0x7fc06c0b8280 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc071e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c073fe0 con 0x7fc054004d40 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc071e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c0ae990 con 0x7fc06c1e14e0 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc06be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06c0b8280 0x7fc06c13a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc06be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06c0b8280 0x7fc06c13a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44024/0 (socket says 172.21.15.5:44024) 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.962+0000 7fc06be00640 1 -- 172.21.15.5:0/3964637817 learned_addr learned my addr 172.21.15.5:0/3964637817 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc071400640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c1e14e0 0x7fc06c1e1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc070a00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc054004d40 0x7fc06c139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc06be00640 1 -- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c1e14e0 msgr2=0x7fc06c1e1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc06be00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c1e14e0 0x7fc06c1e1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc06be00640 1 -- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc054004d40 msgr2=0x7fc06c139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc06be00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc054004d40 0x7fc06c139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc06be00640 1 -- 172.21.15.5:0/3964637817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c0b9680 con 0x7fc06c0b8280 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc070a00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc054004d40 0x7fc06c139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc06be00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06c0b8280 0x7fc06c13a1b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e7d0 tx=0x7fc05c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc068c00640 1 -- 172.21.15.5:0/3964637817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00c8d0 con 0x7fc06c0b8280 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc068c00640 1 -- 172.21.15.5:0/3964637817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c018070 con 0x7fc06c0b8280 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06c070ad0 con 0x7fc06c0b8280 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.963+0000 7fc068c00640 1 -- 172.21.15.5:0/3964637817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00cc90 con 0x7fc06c0b8280 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.964+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06c071b50 con 0x7fc06c0b8280 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.965+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc06c075db0 con 0x7fc06c0b8280 2024-04-26T21:37:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.966+0000 7fc068c00640 1 -- 172.21.15.5:0/3964637817 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc05c01d460 con 0x7fc06c0b8280 2024-04-26T21:37:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.967+0000 7fc068c00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc05006c8f0 0x7fc05006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.968+0000 7fc068c00640 1 -- 172.21.15.5:0/3964637817 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc05c08bd30 con 0x7fc06c0b8280 2024-04-26T21:37:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.968+0000 7fc070a00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc05006c8f0 0x7fc05006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.969+0000 7fc070a00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc05006c8f0 0x7fc05006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc06c1462e0 tx=0x7fc060008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:50.972+0000 7fc068c00640 1 -- 172.21.15.5:0/3964637817 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc05c059eb0 con 0x7fc06c0b8280 2024-04-26T21:37:51.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.175+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc06c071870 con 0x7fc06c0b8280 2024-04-26T21:37:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.176+0000 7fc068c00640 1 -- 172.21.15.5:0/3964637817 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fc05c060080 con 0x7fc06c0b8280 2024-04-26T21:37:51.177 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T21:37:51.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc05006c8f0 msgr2=0x7fc05006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc05006c8f0 0x7fc05006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc06c1462e0 tx=0x7fc060008040 comp rx=0 tx=0).stop 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06c0b8280 msgr2=0x7fc06c13a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06c0b8280 0x7fc06c13a1b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e7d0 tx=0x7fc05c00ec90 comp rx=0 tx=0).stop 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 shutdown_connections 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc06c1e14e0 0x7fc06c1e1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc05006c8f0 0x7fc05006edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06c0b8280 0x7fc06c13a1b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 --2- 172.21.15.5:0/3964637817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc054004d40 0x7fc06c139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 >> 172.21.15.5:0/3964637817 conn(0x7fc06c06c720 msgr2=0x7fc06c0b4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 shutdown_connections 2024-04-26T21:37:51.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.179+0000 7fc071e00640 1 -- 172.21.15.5:0/3964637817 wait complete. 2024-04-26T21:37:51.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:37:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.411+0000 7f8711e00640 1 Processor -- start 2024-04-26T21:37:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.412+0000 7f8711e00640 1 -- start start 2024-04-26T21:37:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.413+0000 7f8711e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f870c0b89d0 0x7f870c14b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.413+0000 7f8711e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c14bfa0 con 0x7f870c14b660 2024-04-26T21:37:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.413+0000 7f8711e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c0686e0 con 0x7f870c068300 2024-04-26T21:37:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.413+0000 7f8711e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f870c14ce70 con 0x7f870c0b89d0 2024-04-26T21:37:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.413+0000 7f870a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f870c0b89d0 0x7f870c14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.413+0000 7f870a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f870c0b89d0 0x7f870c14b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44032/0 (socket says 172.21.15.5:44032) 2024-04-26T21:37:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.413+0000 7f870a000640 1 -- 172.21.15.5:0/871999260 learned_addr learned my addr 172.21.15.5:0/871999260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.414+0000 7f870a000640 1 -- 172.21.15.5:0/871999260 >> v1:172.21.15.112:6789/0 conn(0x7f870c068300 legacy=0x7f870c14c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:51.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.414+0000 7f870a000640 1 -- 172.21.15.5:0/871999260 >> v1:172.21.15.5:6789/0 conn(0x7f870c14b660 legacy=0x7f870c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.414+0000 7f870a000640 1 -- 172.21.15.5:0/871999260 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c0b9e70 con 0x7f870c0b89d0 2024-04-26T21:37:51.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.414+0000 7f8709600640 1 -- 172.21.15.5:0/871999260 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820357023 0 0) 0x7f870c14bfa0 con 0x7f870c14b660 2024-04-26T21:37:51.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.415+0000 7f870a000640 1 --2- 172.21.15.5:0/871999260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c14b120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009e50 tx=0x7f86f402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdc1926ce81bcb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.415+0000 7f8709600640 1 -- 172.21.15.5:0/871999260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4036070 con 0x7f870c0b89d0 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.415+0000 7f8709600640 1 -- 172.21.15.5:0/871999260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f4031600 con 0x7f870c0b89d0 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.415+0000 7f8709600640 1 -- 172.21.15.5:0/871999260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40319d0 con 0x7f870c0b89d0 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.416+0000 7f8711e00640 1 -- 172.21.15.5:0/871999260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 msgr2=0x7f870c14b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.416+0000 7f8711e00640 1 --2- 172.21.15.5:0/871999260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c14b120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009e50 tx=0x7f86f402a730 comp rx=0 tx=0).stop 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.416+0000 7f8711e00640 1 -- 172.21.15.5:0/871999260 shutdown_connections 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.416+0000 7f8711e00640 1 --2- 172.21.15.5:0/871999260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c14b120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.416+0000 7f8711e00640 1 -- 172.21.15.5:0/871999260 >> 172.21.15.5:0/871999260 conn(0x7f870c06cd80 msgr2=0x7f870c0ba3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:51.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.416+0000 7f8711e00640 1 -- 172.21.15.5:0/871999260 shutdown_connections 2024-04-26T21:37:51.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.416+0000 7f8711e00640 1 -- 172.21.15.5:0/871999260 wait complete. 2024-04-26T21:37:51.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.417+0000 7f8711e00640 1 Processor -- start 2024-04-26T21:37:51.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.418+0000 7f8711e00640 1 -- start start 2024-04-26T21:37:51.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.418+0000 7f8711e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f870c068300 0x7f870c0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.418+0000 7f8711e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.418+0000 7f8711e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f870c14b660 0x7f870c144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.418+0000 7f8711e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f870c0b8ff0 con 0x7f870c0b89d0 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.418+0000 7f8711e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f870c14c2d0 con 0x7f870c068300 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.418+0000 7f8711e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f870c0b9170 con 0x7f870c14b660 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44042/0 (socket says 172.21.15.5:44042) 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 -- 172.21.15.5:0/2255985758 learned_addr learned my addr 172.21.15.5:0/2255985758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870aa00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f870c068300 0x7f870c0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 -- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f870c14b660 msgr2=0x7f870c144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f870c14b660 0x7f870c144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 -- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f870c068300 msgr2=0x7f870c0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f870c068300 0x7f870c0b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 -- 172.21.15.5:0/2255985758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c09ad10 con 0x7f870c0b89d0 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870aa00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f870c068300 0x7f870c0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.419+0000 7f870a000640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c073160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009e50 tx=0x7f86f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.420+0000 7f8703400640 1 -- 172.21.15.5:0/2255985758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4041020 con 0x7f870c0b89d0 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.420+0000 7f8703400640 1 -- 172.21.15.5:0/2255985758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f4037040 con 0x7f870c0b89d0 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.420+0000 7f8703400640 1 -- 172.21.15.5:0/2255985758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4036050 con 0x7f870c0b89d0 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.420+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870c149d20 con 0x7f870c0b89d0 2024-04-26T21:37:51.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.420+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f870c074600 con 0x7f870c0b89d0 2024-04-26T21:37:51.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.421+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870c0b4ac0 con 0x7f870c0b89d0 2024-04-26T21:37:51.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.422+0000 7f8703400640 1 -- 172.21.15.5:0/2255985758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86f4007c50 con 0x7f870c0b89d0 2024-04-26T21:37:51.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.423+0000 7f8703400640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f86e806c8f0 0x7f86e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.423+0000 7f8703400640 1 -- 172.21.15.5:0/2255985758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f86f40ac760 con 0x7f870c0b89d0 2024-04-26T21:37:51.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.423+0000 7f870aa00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f86e806c8f0 0x7f86e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.425+0000 7f870aa00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f86e806c8f0 0x7f86e806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f870c09e860 tx=0x7f86fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:51.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.427+0000 7f8703400640 1 -- 172.21.15.5:0/2255985758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f870c0b4ac0 con 0x7f870c0b89d0 2024-04-26T21:37:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.631+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f870c075db0 con 0x7f870c0b89d0 2024-04-26T21:37:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.631+0000 7f8703400640 1 -- 172.21.15.5:0/2255985758 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f86f404b060 con 0x7f870c0b89d0 2024-04-26T21:37:51.633 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f86e806c8f0 msgr2=0x7f86e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f86e806c8f0 0x7f86e806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f870c09e860 tx=0x7f86fc009040 comp rx=0 tx=0).stop 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 msgr2=0x7f870c073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c073160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009e50 tx=0x7f86f4004a40 comp rx=0 tx=0).stop 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 shutdown_connections 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f870c14b660 0x7f870c144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f86e806c8f0 0x7f86e806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f870c0b89d0 0x7f870c073160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 --2- 172.21.15.5:0/2255985758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f870c068300 0x7f870c0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.634+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 >> 172.21.15.5:0/2255985758 conn(0x7f870c06cd80 msgr2=0x7f870c14c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.635+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 shutdown_connections 2024-04-26T21:37:51.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.635+0000 7f8711e00640 1 -- 172.21.15.5:0/2255985758 wait complete. 2024-04-26T21:37:51.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:37:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.868+0000 7fa259800640 1 Processor -- start 2024-04-26T21:37:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.868+0000 7fa259800640 1 -- start start 2024-04-26T21:37:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.870+0000 7fa259800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa25414c9b0 0x7fa2540b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.870+0000 7fa259800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2540b70c0 con 0x7fa2540b6ce0 2024-04-26T21:37:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.870+0000 7fa259800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25414ffc0 con 0x7fa2540b3d40 2024-04-26T21:37:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.870+0000 7fa259800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa2540b35d0 con 0x7fa25414c9b0 2024-04-26T21:37:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.870+0000 7fa24be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa25414c9b0 0x7fa2540b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.870+0000 7fa24be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa25414c9b0 0x7fa2540b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44046/0 (socket says 172.21.15.5:44046) 2024-04-26T21:37:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.870+0000 7fa24be00640 1 -- 172.21.15.5:0/4071738269 learned_addr learned my addr 172.21.15.5:0/4071738269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.871+0000 7fa24be00640 1 -- 172.21.15.5:0/4071738269 >> v1:172.21.15.112:6789/0 conn(0x7fa2540b3d40 legacy=0x7fa2540736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.871+0000 7fa24be00640 1 -- 172.21.15.5:0/4071738269 >> v1:172.21.15.5:6789/0 conn(0x7fa2540b6ce0 legacy=0x7fa2541507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.871+0000 7fa24be00640 1 -- 172.21.15.5:0/4071738269 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2541502a0 con 0x7fa25414c9b0 2024-04-26T21:37:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.872+0000 7fa24be00640 1 --2- 172.21.15.5:0/4071738269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25414c9b0 0x7fa2540b1050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009870 tx=0x7fa23c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaabca251e511ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.872+0000 7fa253400640 1 -- 172.21.15.5:0/4071738269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c037070 con 0x7fa25414c9b0 2024-04-26T21:37:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.872+0000 7fa253400640 1 -- 172.21.15.5:0/4071738269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23c032440 con 0x7fa25414c9b0 2024-04-26T21:37:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.872+0000 7fa253400640 1 -- 172.21.15.5:0/4071738269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c032810 con 0x7fa25414c9b0 2024-04-26T21:37:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.873+0000 7fa259800640 1 -- 172.21.15.5:0/4071738269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25414c9b0 msgr2=0x7fa2540b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.873+0000 7fa259800640 1 --2- 172.21.15.5:0/4071738269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25414c9b0 0x7fa2540b1050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009870 tx=0x7fa23c02a2a0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.873+0000 7fa259800640 1 -- 172.21.15.5:0/4071738269 shutdown_connections 2024-04-26T21:37:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.873+0000 7fa259800640 1 --2- 172.21.15.5:0/4071738269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25414c9b0 0x7fa2540b1050 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.873+0000 7fa259800640 1 -- 172.21.15.5:0/4071738269 >> 172.21.15.5:0/4071738269 conn(0x7fa25406c720 msgr2=0x7fa25406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.873+0000 7fa259800640 1 -- 172.21.15.5:0/4071738269 shutdown_connections 2024-04-26T21:37:51.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.873+0000 7fa259800640 1 -- 172.21.15.5:0/4071738269 wait complete. 2024-04-26T21:37:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.874+0000 7fa259800640 1 Processor -- start 2024-04-26T21:37:51.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.875+0000 7fa259800640 1 -- start start 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.875+0000 7fa259800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2540b3d40 0x7fa2541e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.875+0000 7fa259800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2540b6ce0 0x7fa25413e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.875+0000 7fa259800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa25414c9b0 0x7fa25413c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.875+0000 7fa259800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa254073f70 con 0x7fa2540b3d40 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.875+0000 7fa259800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa254073df0 con 0x7fa25414c9b0 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.875+0000 7fa259800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa254158260 con 0x7fa2540b6ce0 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2540b3d40 0x7fa2541e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2540b3d40 0x7fa2541e57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44062/0 (socket says 172.21.15.5:44062) 2024-04-26T21:37:51.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 -- 172.21.15.5:0/3593707146 learned_addr learned my addr 172.21.15.5:0/3593707146 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa258e00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa25414c9b0 0x7fa25413c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa24be00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2540b6ce0 0x7fa25413e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 -- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2540b6ce0 msgr2=0x7fa25413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2540b6ce0 0x7fa25413e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 -- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa25414c9b0 msgr2=0x7fa25413c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa25414c9b0 0x7fa25413c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 -- 172.21.15.5:0/3593707146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2541e5cf0 con 0x7fa2540b3d40 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa258e00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa25414c9b0 0x7fa25413c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.876+0000 7fa253e00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2540b3d40 0x7fa2541e57b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c400 tx=0x7fa24400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.877+0000 7fa250c00640 1 -- 172.21.15.5:0/3593707146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2440052d0 con 0x7fa2540b3d40 2024-04-26T21:37:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.877+0000 7fa250c00640 1 -- 172.21.15.5:0/3593707146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa244005490 con 0x7fa2540b3d40 2024-04-26T21:37:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.877+0000 7fa250c00640 1 -- 172.21.15.5:0/3593707146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244007260 con 0x7fa2540b3d40 2024-04-26T21:37:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.877+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa254072f10 con 0x7fa2540b3d40 2024-04-26T21:37:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.877+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa254070420 con 0x7fa2540b3d40 2024-04-26T21:37:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.878+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa254075db0 con 0x7fa2540b3d40 2024-04-26T21:37:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.879+0000 7fa250c00640 1 -- 172.21.15.5:0/3593707146 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa244007400 con 0x7fa2540b3d40 2024-04-26T21:37:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.880+0000 7fa250c00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.880+0000 7fa250c00640 1 -- 172.21.15.5:0/3593707146 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa24408b3d0 con 0x7fa2540b3d40 2024-04-26T21:37:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.881+0000 7fa24be00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.882+0000 7fa24be00640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa23006c8f0 0x7fa23006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa23c034000 tx=0x7fa23c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:51.884+0000 7fa250c00640 1 -- 172.21.15.5:0/3593707146 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa2440594b0 con 0x7fa2540b3d40 2024-04-26T21:37:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.082+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa254071fc0 con 0x7fa2540b3d40 2024-04-26T21:37:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.083+0000 7fa250c00640 1 -- 172.21.15.5:0/3593707146 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fa244058db0 con 0x7fa2540b3d40 2024-04-26T21:37:52.084 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa23006c8f0 msgr2=0x7fa23006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa23006c8f0 0x7fa23006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa23c034000 tx=0x7fa23c02e000 comp rx=0 tx=0).stop 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2540b3d40 msgr2=0x7fa2541e57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2540b3d40 0x7fa2541e57b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c400 tx=0x7fa24400c8c0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 shutdown_connections 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa25414c9b0 0x7fa25413c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa2540b6ce0 0x7fa25413e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 --2- 172.21.15.5:0/3593707146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2540b3d40 0x7fa2541e57b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 >> 172.21.15.5:0/3593707146 conn(0x7fa25406c720 msgr2=0x7fa2540b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.085+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 shutdown_connections 2024-04-26T21:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.086+0000 7fa259800640 1 -- 172.21.15.5:0/3593707146 wait complete. 2024-04-26T21:37:52.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:37:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.311+0000 7f06af000640 1 Processor -- start 2024-04-26T21:37:52.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.311+0000 7f06af000640 1 -- start start 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.312+0000 7f06af000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06a80b3710 0x7f06a813f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.312+0000 7f06af000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a80b7130 con 0x7f06a813f6c0 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.312+0000 7f06af000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a80b2f10 con 0x7f06a80b6d50 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.312+0000 7f06af000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f06a813fad0 con 0x7f06a80b3710 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.313+0000 7f06ad200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06a80b3710 0x7f06a813f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.313+0000 7f06ad200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06a80b3710 0x7f06a813f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44078/0 (socket says 172.21.15.5:44078) 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.313+0000 7f06ad200640 1 -- 172.21.15.5:0/3520679265 learned_addr learned my addr 172.21.15.5:0/3520679265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:52.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.313+0000 7f06ae600640 1 --1- 172.21.15.5:0/3520679265 >> v1:172.21.15.5:6789/0 conn(0x7f06a813f6c0 0x7f06a814fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53090/0 (socket says 172.21.15.5:53090) 2024-04-26T21:37:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.313+0000 7f06ad200640 1 -- 172.21.15.5:0/3520679265 >> v1:172.21.15.112:6789/0 conn(0x7f06a80b6d50 legacy=0x7f06a8145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.313+0000 7f06ad200640 1 -- 172.21.15.5:0/3520679265 >> v1:172.21.15.5:6789/0 conn(0x7f06a813f6c0 legacy=0x7f06a814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.313+0000 7f06ad200640 1 -- 172.21.15.5:0/3520679265 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a80b31f0 con 0x7f06a80b3710 2024-04-26T21:37:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.314+0000 7f06ad200640 1 --2- 172.21.15.5:0/3520679265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813f180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0698009870 tx=0x7f069802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b29aaa62c5febbd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.315+0000 7f06a7e00640 1 -- 172.21.15.5:0/3520679265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698037070 con 0x7f06a80b3710 2024-04-26T21:37:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.315+0000 7f06a7e00640 1 -- 172.21.15.5:0/3520679265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0698032440 con 0x7f06a80b3710 2024-04-26T21:37:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.315+0000 7f06a7e00640 1 -- 172.21.15.5:0/3520679265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698032810 con 0x7f06a80b3710 2024-04-26T21:37:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.315+0000 7f06af000640 1 -- 172.21.15.5:0/3520679265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 msgr2=0x7f06a813f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.315+0000 7f06af000640 1 --2- 172.21.15.5:0/3520679265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813f180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0698009870 tx=0x7f069802a1e0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.315+0000 7f06af000640 1 -- 172.21.15.5:0/3520679265 shutdown_connections 2024-04-26T21:37:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.315+0000 7f06af000640 1 --2- 172.21.15.5:0/3520679265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813f180 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.316+0000 7f06af000640 1 -- 172.21.15.5:0/3520679265 >> 172.21.15.5:0/3520679265 conn(0x7f06a806c720 msgr2=0x7f06a806cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.316+0000 7f06af000640 1 -- 172.21.15.5:0/3520679265 shutdown_connections 2024-04-26T21:37:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.316+0000 7f06af000640 1 -- 172.21.15.5:0/3520679265 wait complete. 2024-04-26T21:37:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.318+0000 7f06af000640 1 Processor -- start 2024-04-26T21:37:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.318+0000 7f06af000640 1 -- start start 2024-04-26T21:37:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06af000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06af000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80b6d50 0x7f06a81ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06af000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a813f6c0 0x7f06a81de520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06af000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80b6410 con 0x7f06a80b3710 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06af000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80b2cc0 con 0x7f06a813f6c0 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06af000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f06a80b0b40 con 0x7f06a80b6d50 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06adc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06adc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44088/0 (socket says 172.21.15.5:44088) 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06adc00640 1 -- 172.21.15.5:0/2381305551 learned_addr learned my addr 172.21.15.5:0/2381305551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06ae600640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a813f6c0 0x7f06a81de520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.319+0000 7f06ad200640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80b6d50 0x7f06a81ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06adc00640 1 -- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80b6d50 msgr2=0x7f06a81ddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06adc00640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80b6d50 0x7f06a81ddfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06adc00640 1 -- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a813f6c0 msgr2=0x7f06a81de520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06adc00640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a813f6c0 0x7f06a81de520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06adc00640 1 -- 172.21.15.5:0/2381305551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a8073180 con 0x7f06a80b3710 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06ae600640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a813f6c0 0x7f06a81de520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06adc00640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813e1f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c450 tx=0x7f069c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06a5600640 1 -- 172.21.15.5:0/2381305551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c0052d0 con 0x7f06a80b3710 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06a5600640 1 -- 172.21.15.5:0/2381305551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c005470 con 0x7f06a80b3710 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06a5600640 1 -- 172.21.15.5:0/2381305551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c012870 con 0x7f06a80b3710 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.320+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a8073460 con 0x7f06a80b3710 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.321+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a8072350 con 0x7f06a80b3710 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.322+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a8075db0 con 0x7f06a80b3710 2024-04-26T21:37:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.323+0000 7f06a5600640 1 -- 172.21.15.5:0/2381305551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f069c012a10 con 0x7f06a80b3710 2024-04-26T21:37:52.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.324+0000 7f06a5600640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f068c06c8f0 0x7f068c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.324+0000 7f06a5600640 1 -- 172.21.15.5:0/2381305551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f069c08ba00 con 0x7f06a80b3710 2024-04-26T21:37:52.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.325+0000 7f06ad200640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f068c06c8f0 0x7f068c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.326+0000 7f06ad200640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f068c06c8f0 0x7f068c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0698034000 tx=0x7f069802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:52.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.329+0000 7f06a5600640 1 -- 172.21.15.5:0/2381305551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f069c059b80 con 0x7f06a80b3710 2024-04-26T21:37:52.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.533+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f06a81433a0 con 0x7f06a80b3710 2024-04-26T21:37:52.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.534+0000 7f06a5600640 1 -- 172.21.15.5:0/2381305551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f069c059480 con 0x7f06a80b3710 2024-04-26T21:37:52.535 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f068c06c8f0 msgr2=0x7f068c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f068c06c8f0 0x7f068c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0698034000 tx=0x7f069802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 msgr2=0x7f06a813e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813e1f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c450 tx=0x7f069c00c910 comp rx=0 tx=0).stop 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 shutdown_connections 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06a813f6c0 0x7f06a81de520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06a80b6d50 0x7f06a81ddfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f068c06c8f0 0x7f068c06edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 --2- 172.21.15.5:0/2381305551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06a80b3710 0x7f06a813e1f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.536+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 >> 172.21.15.5:0/2381305551 conn(0x7f06a806c720 msgr2=0x7f06a80b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:52.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.537+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 shutdown_connections 2024-04-26T21:37:52.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.537+0000 7f06af000640 1 -- 172.21.15.5:0/2381305551 wait complete. 2024-04-26T21:37:52.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:37:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.770+0000 7f03d1800640 1 Processor -- start 2024-04-26T21:37:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.771+0000 7f03d1800640 1 -- start start 2024-04-26T21:37:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.772+0000 7f03d1800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 0x7f03cc0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.772+0000 7f03d1800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03cc0bb260 con 0x7f03cc142310 2024-04-26T21:37:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.772+0000 7f03d1800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03cc0b6270 con 0x7f03cc148d10 2024-04-26T21:37:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.772+0000 7f03d1800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f03cc0b6550 con 0x7f03cc0bae80 2024-04-26T21:37:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.772+0000 7f03cb400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03cc142310 0x7f03cc148600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53102/0 (socket says 172.21.15.5:53102) 2024-04-26T21:37:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.772+0000 7f03cb400640 1 -- 172.21.15.5:0/4126661626 learned_addr learned my addr 172.21.15.5:0/4126661626 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216819922 0 0) 0x7f03cc0bb260 con 0x7f03cc142310 2024-04-26T21:37:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03cbe00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 0x7f03cc0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03ac003520 con 0x7f03cc142310 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 886218286 0 0) 0x7f03ac003520 con 0x7f03cc142310 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 msgr2=0x7f03cc0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 0x7f03cc0b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 >> v1:172.21.15.112:6789/0 conn(0x7f03cc148d10 legacy=0x7f03cc152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03cc0b6830 con 0x7f03cc142310 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f03b40019f0 con 0x7f03cc142310 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 >> v1:172.21.15.5:6789/0 conn(0x7f03cc142310 legacy=0x7f03cc148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ac0039e0 0x7f03ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.773+0000 7f03caa00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac004800 0x7f03ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03caa00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 0x7f03ac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03cc0b6550 con 0x7f03ac0039e0 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac00baf0 con 0x7f03ac004800 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f03ac00bcf0 con 0x7f03cc0bae80 2024-04-26T21:37:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cbe00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ac0039e0 0x7f03ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cb400640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac004800 0x7f03ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03d0e00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 0x7f03ac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cbe00640 1 -- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 msgr2=0x7f03ac005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cbe00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 0x7f03ac005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cbe00640 1 -- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac004800 msgr2=0x7f03ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cbe00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac004800 0x7f03ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cbe00640 1 -- 172.21.15.5:0/4126661626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ac003520 con 0x7f03ac0039e0 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03d0e00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc0bae80 0x7f03ac005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.774+0000 7f03cb400640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac004800 0x7f03ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.775+0000 7f03cbe00640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ac0039e0 0x7f03ac003e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009ac0 tx=0x7f03ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04f8b3fab43877d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.775+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc036070 con 0x7f03ac0039e0 2024-04-26T21:37:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.775+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03bc031400 con 0x7f03ac0039e0 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.775+0000 7f03caa00640 1 -- 172.21.15.5:0/4126661626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc009690 con 0x7f03ac0039e0 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.776+0000 7f03d1800640 1 -- 172.21.15.5:0/4126661626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ac0039e0 msgr2=0x7f03ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.776+0000 7f03d1800640 1 --2- 172.21.15.5:0/4126661626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03ac0039e0 0x7f03ac003e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009ac0 tx=0x7f03ac005830 comp rx=0 tx=0).stop 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.776+0000 7f03d0e00640 1 -- 172.21.15.5:0/4126661626 reap_dead start 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.776+0000 7f03d1800640 1 -- 172.21.15.5:0/4126661626 shutdown_connections 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.776+0000 7f03d1800640 1 -- 172.21.15.5:0/4126661626 >> 172.21.15.5:0/4126661626 conn(0x7f03cc0684b0 msgr2=0x7f03cc0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.776+0000 7f03d1800640 1 -- 172.21.15.5:0/4126661626 shutdown_connections 2024-04-26T21:37:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.776+0000 7f03d1800640 1 -- 172.21.15.5:0/4126661626 wait complete. 2024-04-26T21:37:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.778+0000 7f03d1800640 1 Processor -- start 2024-04-26T21:37:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.778+0000 7f03d1800640 1 -- start start 2024-04-26T21:37:52.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac0039e0 0x7f03cc1e1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d1800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc1437b0 0x7f03cc0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03cc143c30 0x7f03cc0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d1800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03cc0b57d0 con 0x7f03cc143c30 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d1800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03cc0ba3a0 con 0x7f03ac0039e0 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d1800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f03cc0b5950 con 0x7f03cc1437b0 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03cc143c30 0x7f03cc0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03cc143c30 0x7f03cc0b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44102/0 (socket says 172.21.15.5:44102) 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03d0e00640 1 -- 172.21.15.5:0/2559695644 learned_addr learned my addr 172.21.15.5:0/2559695644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03cbe00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac0039e0 0x7f03cc1e1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.779+0000 7f03cb400640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc1437b0 0x7f03cc0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d0e00640 1 -- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc1437b0 msgr2=0x7f03cc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d0e00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc1437b0 0x7f03cc0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d0e00640 1 -- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac0039e0 msgr2=0x7f03cc1e1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d0e00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac0039e0 0x7f03cc1e1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d0e00640 1 -- 172.21.15.5:0/2559695644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03cc0aa5c0 con 0x7f03cc143c30 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03cbe00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac0039e0 0x7f03cc1e1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03cb400640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc1437b0 0x7f03cc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d0e00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03cc143c30 0x7f03cc0b3720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03cc1490f0 tx=0x7f03c400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03c3e00640 1 -- 172.21.15.5:0/2559695644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4007030 con 0x7f03cc143c30 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03c3e00640 1 -- 172.21.15.5:0/2559695644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c40071f0 con 0x7f03cc143c30 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03c3e00640 1 -- 172.21.15.5:0/2559695644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c40075e0 con 0x7f03cc143c30 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03cc1428f0 con 0x7f03cc143c30 2024-04-26T21:37:52.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.780+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03cc0b46d0 con 0x7f03cc143c30 2024-04-26T21:37:52.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.781+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03cc075db0 con 0x7f03cc143c30 2024-04-26T21:37:52.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.783+0000 7f03c3e00640 1 -- 172.21.15.5:0/2559695644 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03c401b020 con 0x7f03cc143c30 2024-04-26T21:37:52.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.783+0000 7f03c3e00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f03a806c8f0 0x7f03a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:52.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.784+0000 7f03c3e00640 1 -- 172.21.15.5:0/2559695644 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f03c408b870 con 0x7f03cc143c30 2024-04-26T21:37:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.784+0000 7f03cbe00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f03a806c8f0 0x7f03a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.785+0000 7f03cbe00640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f03a806c8f0 0x7f03a806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03bc033000 tx=0x7f03bc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:52.788+0000 7f03c3e00640 1 -- 172.21.15.5:0/2559695644 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f03c4059950 con 0x7f03cc143c30 2024-04-26T21:37:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.035+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03cc13fdf0 con 0x7f03cc143c30 2024-04-26T21:37:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.036+0000 7f03c3e00640 1 -- 172.21.15.5:0/2559695644 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7f03c4059250 con 0x7f03cc143c30 2024-04-26T21:37:53.037 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:53.037 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:39.095752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T21:37:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-04-26T21:37:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f03a806c8f0 msgr2=0x7f03a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f03a806c8f0 0x7f03a806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03bc033000 tx=0x7f03bc008030 comp rx=0 tx=0).stop 2024-04-26T21:37:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03cc143c30 msgr2=0x7f03cc0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03cc143c30 0x7f03cc0b3720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03cc1490f0 tx=0x7f03c400d890 comp rx=0 tx=0).stop 2024-04-26T21:37:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 shutdown_connections 2024-04-26T21:37:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f03a806c8f0 0x7f03a806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03cc143c30 0x7f03cc0b3720 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03cc1437b0 0x7f03cc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 --2- 172.21.15.5:0/2559695644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03ac0039e0 0x7f03cc1e1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 >> 172.21.15.5:0/2559695644 conn(0x7f03cc0684b0 msgr2=0x7f03cc075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 shutdown_connections 2024-04-26T21:37:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.039+0000 7f03d1800640 1 -- 172.21.15.5:0/2559695644 wait complete. 2024-04-26T21:37:53.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:37:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.259+0000 7f4bcce00640 1 Processor -- start 2024-04-26T21:37:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.260+0000 7f4bcce00640 1 -- start start 2024-04-26T21:37:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.261+0000 7f4bcce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 0x7f4bc80b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.261+0000 7f4bcce00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc80bb260 con 0x7f4bc80bae80 2024-04-26T21:37:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.261+0000 7f4bcce00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc80b6270 con 0x7f4bc8142a20 2024-04-26T21:37:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.261+0000 7f4bcce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc80b6550 con 0x7f4bc8148d10 2024-04-26T21:37:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.261+0000 7f4bc7400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bc80bae80 0x7f4bc8142310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53106/0 (socket says 172.21.15.5:53106) 2024-04-26T21:37:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.261+0000 7f4bc7400640 1 -- 172.21.15.5:0/1623647956 learned_addr learned my addr 172.21.15.5:0/1623647956 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc7e00640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 0x7f4bc80b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163691594 0 0) 0x7f4bc80bb260 con 0x7f4bc80bae80 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bac003520 con 0x7f4bc80bae80 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2248229887 0 0) 0x7f4bac003520 con 0x7f4bc80bae80 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 msgr2=0x7f4bc80b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 0x7f4bc80b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 >> v1:172.21.15.112:6789/0 conn(0x7f4bc8142a20 legacy=0x7f4bc8148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc80b6830 con 0x7f4bc80bae80 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f4bb8001670 con 0x7f4bc80bae80 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 >> v1:172.21.15.5:6789/0 conn(0x7f4bc80bae80 legacy=0x7f4bc8142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bac0039e0 0x7f4bac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 0x7f4bac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bac004d40 0x7f4bac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc80b6550 con 0x7f4bac0039e0 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac00bb50 con 0x7f4bac004d40 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.262+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4bac00bd50 con 0x7f4bc8148d10 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7400640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bac0039e0 0x7f4bac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7400640 1 -- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 msgr2=0x7f4bac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7e00640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bac004d40 0x7f4bac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc6a00640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 0x7f4bac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7400640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 0x7f4bac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7400640 1 -- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bac004d40 msgr2=0x7f4bac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7400640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bac004d40 0x7f4bac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7400640 1 -- 172.21.15.5:0/1623647956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac003520 con 0x7f4bac0039e0 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc7e00640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bac004d40 0x7f4bac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:53.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.263+0000 7f4bc6a00640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bc8148d10 0x7f4bac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.264+0000 7f4bc7400640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bac0039e0 0x7f4bac003e00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c190 tx=0x7f4bac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422304b00986b550 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8007c60 con 0x7f4bac0039e0 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb8005ad0 con 0x7f4bac0039e0 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bc6000640 1 -- 172.21.15.5:0/1623647956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8007070 con 0x7f4bac0039e0 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bcce00640 1 -- 172.21.15.5:0/1623647956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bac0039e0 msgr2=0x7f4bac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bcce00640 1 --2- 172.21.15.5:0/1623647956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bac0039e0 0x7f4bac003e00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c190 tx=0x7f4bac005830 comp rx=0 tx=0).stop 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bc7e00640 1 -- 172.21.15.5:0/1623647956 reap_dead start 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bcce00640 1 -- 172.21.15.5:0/1623647956 shutdown_connections 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bcce00640 1 -- 172.21.15.5:0/1623647956 >> 172.21.15.5:0/1623647956 conn(0x7f4bc80684b0 msgr2=0x7f4bc80688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bcce00640 1 -- 172.21.15.5:0/1623647956 shutdown_connections 2024-04-26T21:37:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.265+0000 7f4bcce00640 1 -- 172.21.15.5:0/1623647956 wait complete. 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.267+0000 7f4bcce00640 1 Processor -- start 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.267+0000 7f4bcce00640 1 -- start start 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bcce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bac0039e0 0x7f4bc8145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bcce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc814ba40 0x7f4bc814bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bcce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc81e1020 0x7f4bc81e1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bcce00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc80b5950 con 0x7f4bc814ba40 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bcce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc80b57d0 con 0x7f4bc81e1020 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bcce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc80b5ad0 con 0x7f4bac0039e0 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc814ba40 0x7f4bc814bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc814ba40 0x7f4bc814bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44120/0 (socket says 172.21.15.5:44120) 2024-04-26T21:37:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.268+0000 7f4bc6a00640 1 -- 172.21.15.5:0/791635305 learned_addr learned my addr 172.21.15.5:0/791635305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc7e00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc81e1020 0x7f4bc81e1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc7400640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bac0039e0 0x7f4bc8145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc6a00640 1 -- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bac0039e0 msgr2=0x7f4bc8145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc6a00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bac0039e0 0x7f4bc8145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc6a00640 1 -- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc81e1020 msgr2=0x7f4bc81e1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc6a00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc81e1020 0x7f4bc81e1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc6a00640 1 -- 172.21.15.5:0/791635305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc81d2eb0 con 0x7f4bc814ba40 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc7400640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bac0039e0 0x7f4bc8145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc7e00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc81e1020 0x7f4bc81e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bc6a00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc814ba40 0x7f4bc814bec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000d590 tx=0x7f4bb000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.269+0000 7f4bbf400640 1 -- 172.21.15.5:0/791635305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0005480 con 0x7f4bc814ba40 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.270+0000 7f4bbf400640 1 -- 172.21.15.5:0/791635305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0017070 con 0x7f4bc814ba40 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.270+0000 7f4bbf400640 1 -- 172.21.15.5:0/791635305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0003810 con 0x7f4bc814ba40 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.270+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc813df10 con 0x7f4bc814ba40 2024-04-26T21:37:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.270+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc81d3400 con 0x7f4bc814ba40 2024-04-26T21:37:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.271+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc8075db0 con 0x7f4bc814ba40 2024-04-26T21:37:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.272+0000 7f4bbf400640 1 -- 172.21.15.5:0/791635305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4bb00039b0 con 0x7f4bc814ba40 2024-04-26T21:37:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.273+0000 7f4bbf400640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4ba406c8f0 0x7f4ba406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.274+0000 7f4bbf400640 1 -- 172.21.15.5:0/791635305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4bb008bce0 con 0x7f4bc814ba40 2024-04-26T21:37:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.274+0000 7f4bc7400640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4ba406c8f0 0x7f4ba406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.275+0000 7f4bc7400640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4ba406c8f0 0x7f4ba406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c160 tx=0x7f4bb8009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.278+0000 7f4bbf400640 1 -- 172.21.15.5:0/791635305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4bc813df10 con 0x7f4bc814ba40 2024-04-26T21:37:53.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.489+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bc81d3120 con 0x7f4bc814ba40 2024-04-26T21:37:53.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.491+0000 7f4bbf400640 1 -- 172.21.15.5:0/791635305 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f4bb0019310 con 0x7f4bc814ba40 2024-04-26T21:37:53.493 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:53.493 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:21.940463+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:37:53.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.494+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4ba406c8f0 msgr2=0x7f4ba406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.494+0000 7f4bcce00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4ba406c8f0 0x7f4ba406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c160 tx=0x7f4bb8009030 comp rx=0 tx=0).stop 2024-04-26T21:37:53.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.494+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc814ba40 msgr2=0x7f4bc814bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.494+0000 7f4bcce00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc814ba40 0x7f4bc814bec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000d590 tx=0x7f4bb000da50 comp rx=0 tx=0).stop 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 shutdown_connections 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bc81e1020 0x7f4bc81e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4ba406c8f0 0x7f4ba406edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc814ba40 0x7f4bc814bec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 --2- 172.21.15.5:0/791635305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bac0039e0 0x7f4bc8145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 >> 172.21.15.5:0/791635305 conn(0x7f4bc80684b0 msgr2=0x7f4bc8075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 shutdown_connections 2024-04-26T21:37:53.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.495+0000 7f4bcce00640 1 -- 172.21.15.5:0/791635305 wait complete. 2024-04-26T21:37:53.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:37:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.718+0000 7f360f200640 1 Processor -- start 2024-04-26T21:37:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.718+0000 7f360f200640 1 -- start start 2024-04-26T21:37:53.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.719+0000 7f360f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 0x7f36100b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.719+0000 7f360f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36100b4a30 con 0x7f361013f0a0 2024-04-26T21:37:53.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.719+0000 7f360f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36100b3720 con 0x7f36100b4650 2024-04-26T21:37:53.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.719+0000 7f360f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3610145810 con 0x7f36100b0ee0 2024-04-26T21:37:53.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.720+0000 7f360e800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f361013f0a0 0x7f361014fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53116/0 (socket says 172.21.15.5:53116) 2024-04-26T21:37:53.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.720+0000 7f360e800640 1 -- 172.21.15.5:0/3578387846 learned_addr learned my addr 172.21.15.5:0/3578387846 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.720+0000 7f360d400640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 0x7f36100b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.720+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178963450 0 0) 0x7f36100b4a30 con 0x7f361013f0a0 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.720+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f4003520 con 0x7f361013f0a0 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2368743745 0 0) 0x7f35f4003520 con 0x7f361013f0a0 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 msgr2=0x7f36100b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 0x7f36100b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 >> v1:172.21.15.112:6789/0 conn(0x7f36100b4650 legacy=0x7f3610145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101454a0 con 0x7f361013f0a0 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f36080019f0 con 0x7f361013f0a0 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 >> v1:172.21.15.5:6789/0 conn(0x7f361013f0a0 legacy=0x7f361014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 0x7f35f40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4003fb0 0x7f35f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4004d40 0x7f35f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3610145810 con 0x7f35f4004d40 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35f400bbb0 con 0x7f35f4003fb0 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f35f400bdb0 con 0x7f36100b0ee0 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360e800640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4004d40 0x7f35f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.721+0000 7f360de00640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 0x7f35f40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.722+0000 7f360d400640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4003fb0 0x7f35f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.722+0000 7f360e800640 1 -- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 msgr2=0x7f35f40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.722+0000 7f360e800640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36100b0ee0 0x7f35f40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.722+0000 7f360e800640 1 -- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4003fb0 msgr2=0x7f35f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.722+0000 7f360e800640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4003fb0 0x7f35f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.722+0000 7f360e800640 1 -- 172.21.15.5:0/3578387846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f4003520 con 0x7f35f4004d40 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.723+0000 7f360e800640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4004d40 0x7f35f40051c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f360800a770 tx=0x7f35f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9972b1560c12fdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.723+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360800a390 con 0x7f35f4004d40 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.723+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360802f070 con 0x7f35f4004d40 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.723+0000 7f360ca00640 1 -- 172.21.15.5:0/3578387846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360802bc20 con 0x7f35f4004d40 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.724+0000 7f360f200640 1 -- 172.21.15.5:0/3578387846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4004d40 msgr2=0x7f35f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.724+0000 7f360f200640 1 --2- 172.21.15.5:0/3578387846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4004d40 0x7f35f40051c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f360800a770 tx=0x7f35f4005830 comp rx=0 tx=0).stop 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.724+0000 7f360e800640 1 -- 172.21.15.5:0/3578387846 reap_dead start 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.724+0000 7f360f200640 1 -- 172.21.15.5:0/3578387846 shutdown_connections 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.724+0000 7f360f200640 1 -- 172.21.15.5:0/3578387846 >> 172.21.15.5:0/3578387846 conn(0x7f361006c300 msgr2=0x7f361006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.724+0000 7f360f200640 1 -- 172.21.15.5:0/3578387846 shutdown_connections 2024-04-26T21:37:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.724+0000 7f360f200640 1 -- 172.21.15.5:0/3578387846 wait complete. 2024-04-26T21:37:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.725+0000 7f360f200640 1 Processor -- start 2024-04-26T21:37:53.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.726+0000 7f360f200640 1 -- start start 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.726+0000 7f360f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4004d40 0x7f361013d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.726+0000 7f360f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36101ddb80 0x7f36101ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.726+0000 7f360f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3610139b20 0x7f3610139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.726+0000 7f360f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f36100b3010 con 0x7f36101ddb80 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.726+0000 7f360f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3610070740 con 0x7f35f4004d40 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.726+0000 7f360f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f36100b3190 con 0x7f3610139b20 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36101ddb80 0x7f36101ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36101ddb80 0x7f36101ddfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44144/0 (socket says 172.21.15.5:44144) 2024-04-26T21:37:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 -- 172.21.15.5:0/1679308611 learned_addr learned my addr 172.21.15.5:0/1679308611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360e800640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3610139b20 0x7f3610139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360de00640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4004d40 0x7f361013d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 -- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3610139b20 msgr2=0x7f3610139fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3610139b20 0x7f3610139fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 -- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4004d40 msgr2=0x7f361013d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4004d40 0x7f361013d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 -- 172.21.15.5:0/1679308611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101de520 con 0x7f36101ddb80 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360e800640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3610139b20 0x7f3610139fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.727+0000 7f360d400640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36101ddb80 0x7f36101ddfe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35fc011560 tx=0x7f35fc011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.728+0000 7f3606000640 1 -- 172.21.15.5:0/1679308611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc004220 con 0x7f36101ddb80 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.728+0000 7f3606000640 1 -- 172.21.15.5:0/1679308611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35fc0043c0 con 0x7f36101ddb80 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.728+0000 7f3606000640 1 -- 172.21.15.5:0/1679308611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc015870 con 0x7f36101ddb80 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.728+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36100710e0 con 0x7f36101ddb80 2024-04-26T21:37:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.728+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361013e520 con 0x7f36101ddb80 2024-04-26T21:37:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.729+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3610075db0 con 0x7f36101ddb80 2024-04-26T21:37:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.730+0000 7f3606000640 1 -- 172.21.15.5:0/1679308611 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35fc015a10 con 0x7f36101ddb80 2024-04-26T21:37:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.731+0000 7f3606000640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f35f006c920 0x7f35f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.731+0000 7f3606000640 1 -- 172.21.15.5:0/1679308611 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f35fc08c1b0 con 0x7f36101ddb80 2024-04-26T21:37:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.732+0000 7f360de00640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f35f006c920 0x7f35f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:53.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.733+0000 7f360de00640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f35f006c920 0x7f35f006ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3600007fd0 tx=0x7f3600009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:53.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.735+0000 7f3606000640 1 -- 172.21.15.5:0/1679308611 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f35fc019030 con 0x7f36101ddb80 2024-04-26T21:37:53.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.978+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36100af120 con 0x7f36101ddb80 2024-04-26T21:37:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.980+0000 7f3606000640 1 -- 172.21.15.5:0/1679308611 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7f35fc05a200 con 0x7f36101ddb80 2024-04-26T21:37:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T21:37:53.981 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:39.095752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T21:37:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.982+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f35f006c920 msgr2=0x7f35f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.982+0000 7f360f200640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f35f006c920 0x7f35f006ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3600007fd0 tx=0x7f3600009040 comp rx=0 tx=0).stop 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.982+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36101ddb80 msgr2=0x7f36101ddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.982+0000 7f360f200640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36101ddb80 0x7f36101ddfe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35fc011560 tx=0x7f35fc011a20 comp rx=0 tx=0).stop 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 shutdown_connections 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3610139b20 0x7f3610139fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f35f006c920 0x7f35f006ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36101ddb80 0x7f36101ddfe0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 --2- 172.21.15.5:0/1679308611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35f4004d40 0x7f361013d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 >> 172.21.15.5:0/1679308611 conn(0x7f361006c300 msgr2=0x7f3610075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 shutdown_connections 2024-04-26T21:37:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:53.983+0000 7f360f200640 1 -- 172.21.15.5:0/1679308611 wait complete. 2024-04-26T21:37:54.205 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:37:16.886712+0000', 'modified': '2024-04-26T21:37:39.095752+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6835/1466535528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1466535528}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 1466535528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-04-26T21:37:54.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:37:54.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T21:37:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.414+0000 7f3b51600640 1 Processor -- start 2024-04-26T21:37:54.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.414+0000 7f3b51600640 1 -- start start 2024-04-26T21:37:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.416+0000 7f3b51600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3b4c151f10 0x7f3b4c154300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.416+0000 7f3b51600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b4c0b5390 con 0x7f3b4c0b6640 2024-04-26T21:37:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.416+0000 7f3b51600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b4c0bb310 con 0x7f3b4c0baf30 2024-04-26T21:37:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.416+0000 7f3b51600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4c0b5b50 con 0x7f3b4c151f10 2024-04-26T21:37:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.416+0000 7f3b43e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b4c0b6640 0x7f3b4c142270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48890/0 (socket says 172.21.15.5:48890) 2024-04-26T21:37:54.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.416+0000 7f3b43e00640 1 -- 172.21.15.5:0/669261882 learned_addr learned my addr 172.21.15.5:0/669261882 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:54.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.416+0000 7f3b4b400640 1 --2- 172.21.15.5:0/669261882 >> v2:172.21.15.112:3300/0 conn(0x7f3b4c151f10 0x7f3b4c154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917680427 0 0) 0x7f3b4c0b5390 con 0x7f3b4c0b6640 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b30003520 con 0x7f3b4c0b6640 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2389103786 0 0) 0x7f3b30003520 con 0x7f3b4c0b6640 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 >> v2:172.21.15.112:3300/0 conn(0x7f3b4c151f10 msgr2=0x7f3b4c154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 --2- 172.21.15.5:0/669261882 >> v2:172.21.15.112:3300/0 conn(0x7f3b4c151f10 0x7f3b4c154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 >> v1:172.21.15.112:6789/0 conn(0x7f3b4c0baf30 legacy=0x7f3b4c14bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c0b7a90 con 0x7f3b4c0b6640 2024-04-26T21:37:54.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f3b34001670 con 0x7f3b4c0b6640 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 >> v1:172.21.15.5:6789/0 conn(0x7f3b4c0b6640 legacy=0x7f3b4c142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b300039b0 0x7f3b30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b30004800 0x7f3b30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b300051c0 0x7f3b3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0b5b50 con 0x7f3b300039b0 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3000c160 con 0x7f3b300051c0 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3000c360 con 0x7f3b30004800 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.417+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b300039b0 0x7f3b30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b4b400640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b300051c0 0x7f3b3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b43e00640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b30004800 0x7f3b30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b4aa00640 1 -- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b30004800 msgr2=0x7f3b30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b30004800 0x7f3b30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b4aa00640 1 -- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b300051c0 msgr2=0x7f3b3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b300051c0 0x7f3b3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b4aa00640 1 -- 172.21.15.5:0/669261882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b30003520 con 0x7f3b300039b0 2024-04-26T21:37:54.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b4b400640 1 -- 172.21.15.5:0/669261882 reap_dead start 2024-04-26T21:37:54.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.418+0000 7f3b43e00640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b30004800 0x7f3b30004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:54.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.419+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b300039b0 0x7f3b30003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c001720 tx=0x7f3b30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927e1719de475d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.419+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c001370 con 0x7f3b300039b0 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.419+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0052d0 con 0x7f3b300039b0 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.419+0000 7f3b4a000640 1 -- 172.21.15.5:0/669261882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c02aba0 con 0x7f3b300039b0 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.420+0000 7f3b51600640 1 -- 172.21.15.5:0/669261882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b300039b0 msgr2=0x7f3b30003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.420+0000 7f3b51600640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b300039b0 0x7f3b30003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c001720 tx=0x7f3b30005830 comp rx=0 tx=0).stop 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.420+0000 7f3b51600640 1 -- 172.21.15.5:0/669261882 shutdown_connections 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.420+0000 7f3b51600640 1 --2- 172.21.15.5:0/669261882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b300039b0 0x7f3b30003dd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.420+0000 7f3b51600640 1 -- 172.21.15.5:0/669261882 >> 172.21.15.5:0/669261882 conn(0x7f3b4c068270 msgr2=0x7f3b4c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:54.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.420+0000 7f3b51600640 1 -- 172.21.15.5:0/669261882 shutdown_connections 2024-04-26T21:37:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.420+0000 7f3b51600640 1 -- 172.21.15.5:0/669261882 wait complete. 2024-04-26T21:37:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.422+0000 7f3b51600640 1 Processor -- start 2024-04-26T21:37:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.422+0000 7f3b51600640 1 -- start start 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.422+0000 7f3b51600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b300039b0 0x7f3b4c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b51600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b4c1494e0 0x7f3b4c145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b51600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4c145d80 0x7f3b4c1e2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b51600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0b76f0 con 0x7f3b4c145d80 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b51600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0b5690 con 0x7f3b4c1494e0 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b51600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c0b7870 con 0x7f3b300039b0 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4c145d80 0x7f3b4c1e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4c145d80 0x7f3b4c1e2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55574/0 (socket says 172.21.15.5:55574) 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 -- 172.21.15.5:0/3157345707 learned_addr learned my addr 172.21.15.5:0/3157345707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b300039b0 0x7f3b4c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b43e00640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b4c1494e0 0x7f3b4c145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 -- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b300039b0 msgr2=0x7f3b4c148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b300039b0 0x7f3b4c148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 -- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b4c1494e0 msgr2=0x7f3b4c145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b4c1494e0 0x7f3b4c145840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.423+0000 7f3b4b400640 1 -- 172.21.15.5:0/3157345707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c145420 con 0x7f3b4c145d80 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.424+0000 7f3b4b400640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4c145d80 0x7f3b4c1e2000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0b9bc0 tx=0x7f3b440115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.424+0000 7f3b42a00640 1 -- 172.21.15.5:0/3157345707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44011db0 con 0x7f3b4c145d80 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.424+0000 7f3b42a00640 1 -- 172.21.15.5:0/3157345707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4401b070 con 0x7f3b4c145d80 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.424+0000 7f3b42a00640 1 -- 172.21.15.5:0/3157345707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44003990 con 0x7f3b4c145d80 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.424+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4c1e1960 con 0x7f3b4c145d80 2024-04-26T21:37:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.424+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4c1515e0 con 0x7f3b4c145d80 2024-04-26T21:37:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.427+0000 7f3b42a00640 1 -- 172.21.15.5:0/3157345707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b44003b30 con 0x7f3b4c145d80 2024-04-26T21:37:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.428+0000 7f3b42a00640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3b2806c8f0 0x7f3b2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.428+0000 7f3b54449740 1 Processor -- start 2024-04-26T21:37:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.428+0000 7f3b42a00640 1 -- 172.21.15.5:0/3157345707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3b4408c730 con 0x7f3b4c145d80 2024-04-26T21:37:54.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.428+0000 7f3b54449740 1 -- start start 2024-04-26T21:37:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.428+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3b2806c8f0 0x7f3b2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd297e3e80 0x55fd297dff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b54449740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e1530 0x55fd2980be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd2980c380 0x55fd2980c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b54449740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fd29748600 con 0x55fd297e1530 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fd296e5100 con 0x55fd297e3e80 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55fd297445c0 con 0x55fd2980c380 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e1530 0x55fd2980be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e1530 0x55fd2980be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55582/0 (socket says 172.21.15.5:55582) 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b43e00640 1 -- 172.21.15.5:0/4270898525 learned_addr learned my addr 172.21.15.5:0/4270898525 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b4b400640 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd2980c380 0x55fd2980c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.429+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd297e3e80 0x55fd297dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b43e00640 1 -- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd2980c380 msgr2=0x55fd2980c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b43e00640 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd2980c380 0x55fd2980c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b43e00640 1 -- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd297e3e80 msgr2=0x55fd297dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b43e00640 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd297e3e80 0x55fd297dff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b43e00640 1 -- 172.21.15.5:0/4270898525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2945a2d0 con 0x55fd297e1530 2024-04-26T21:37:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b43e00640 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e1530 0x55fd2980be40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c051930 tx=0x7f3b34005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1223db7797e248d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3b2806c8f0 0x7f3b2806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c032000 tx=0x7f3b3c02c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b3b000640 1 -- 172.21.15.5:0/4270898525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400faf0 con 0x55fd297e1530 2024-04-26T21:37:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b3b000640 1 -- 172.21.15.5:0/4270898525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b34018070 con 0x55fd297e1530 2024-04-26T21:37:54.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.430+0000 7f3b3b000640 1 -- 172.21.15.5:0/4270898525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400fe90 con 0x55fd297e1530 2024-04-26T21:37:54.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 -- 172.21.15.5:0/4270898525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e1530 msgr2=0x55fd2980be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e1530 0x55fd2980be40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c051930 tx=0x7f3b34005f10 comp rx=0 tx=0).stop 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 -- 172.21.15.5:0/4270898525 shutdown_connections 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd2980c380 0x55fd2980c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e1530 0x55fd2980be40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 --2- 172.21.15.5:0/4270898525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd297e3e80 0x55fd297dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 -- 172.21.15.5:0/4270898525 >> 172.21.15.5:0/4270898525 conn(0x55fd29778d10 msgr2=0x55fd297e32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 -- 172.21.15.5:0/4270898525 shutdown_connections 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.431+0000 7f3b54449740 1 -- 172.21.15.5:0/4270898525 wait complete. 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.432+0000 7f3b54449740 1 -- start start 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.432+0000 7f3b54449740 1 Processor -- start 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29826230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b54449740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd29802dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd29803300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b54449740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fd29811360 con 0x55fd2980c380 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fd296cff70 con 0x55fd29816b20 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55fd297df730 con 0x55fd297e3e80 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b54449740 10 client.0 _ll_register_callbacks cb 0x55fd2973e480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd29802dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd29802dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55590/0 (socket says 172.21.15.5:55590) 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.433+0000 7f3b43e00640 1 -- 172.21.15.5:0/2195793192 learned_addr learned my addr 172.21.15.5:0/2195793192 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29826230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b4b400640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd29803300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b43e00640 1 -- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 msgr2=0x55fd29826230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b43e00640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29826230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b43e00640 1 -- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 msgr2=0x55fd29803300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b43e00640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd29803300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b43e00640 1 -- 172.21.15.5:0/2195793192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd295246b0 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b4b400640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd29803300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b43e00640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd29802dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b34014000 tx=0x7f3b4c0ba100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98870d5132de800 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b2f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b2f400640 1 -- 172.21.15.5:0/2195793192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34013c30 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b2f400640 1 -- 172.21.15.5:0/2195793192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3b34013dd0 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.434+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b34018070 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b2f400640 1 -- 172.21.15.5:0/2195793192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3b3402d050 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 10 client.4767 fetch_fsmap learned FSMap version 9 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55fd2980d6f0 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b2f400640 1 -- 172.21.15.5:0/2195793192 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b34018070 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b2f400640 1 -- 172.21.15.5:0/2195793192 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 9) ==== 2292+0+0 (secure 0 0 0) 0x7f3b34030020 con 0x55fd2980c380 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 10 client.4767 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T21:37:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 10 client.4767 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T21:37:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 20 client.4767 populate_metadata read hostname 'smithi005' 2024-04-26T21:37:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd2980e660 0x55fd2980ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 4 client.4767 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:37:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.435+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 --> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd29756210 con 0x55fd2980e660 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.436+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd2980e660 0x55fd2980ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.437+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd2980e660 0x55fd2980ea60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac200364230b2d3 server_cookie=a0bf2966c9741d34 in_seq=0 out_seq=0 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.437+0000 7f3b2f400640 10 client.4767 ms_handle_connect on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b2f400640 1 -- 172.21.15.5:0/2195793192 <== mds.0 v2:172.21.15.112:6834/1466535528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fd29756210 con 0x55fd2980e660 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b2f400640 10 client.4767 handle_command_reply: tid=0 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 client.4767 shutdown 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 msgr2=0x55fd29802dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd29802dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b34014000 tx=0x7f3b4c0ba100 comp rx=0 tx=0).stop 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 shutdown_connections 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd2980e660 0x55fd2980ea60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd29803300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd29802dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 --2- 172.21.15.5:0/2195793192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29826230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b2f400640 0 client.4767 ms_handle_reset on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 >> 172.21.15.5:0/2195793192 conn(0x55fd29778d10 msgr2=0x55fd297de620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 shutdown_connections 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.439+0000 7f3b54449740 1 -- 172.21.15.5:0/2195793192 wait complete. 2024-04-26T21:37:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.440+0000 7f3b54449740 20 client.4767 trim_cache size 0 max 16384 2024-04-26T21:37:54.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.459+0000 7f3b54449740 1 Processor -- start 2024-04-26T21:37:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b54449740 1 -- start start 2024-04-26T21:37:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b54449740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e3e80 0x55fd297e4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd2980c380 0x55fd29807f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd29816b20 0x55fd29825c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b54449740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1ec660 con 0x55fd297e3e80 2024-04-26T21:37:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1eb7f0 con 0x55fd2980c380 2024-04-26T21:37:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55fd2980d9d0 con 0x55fd29816b20 2024-04-26T21:37:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.460+0000 7f3b4aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e3e80 0x55fd297e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e3e80 0x55fd297e4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55604/0 (socket says 172.21.15.5:55604) 2024-04-26T21:37:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 -- 172.21.15.5:0/103088866 learned_addr learned my addr 172.21.15.5:0/103088866 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 -- 172.21.15.5:0/103088866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd29816b20 msgr2=0x55fd29825c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/103088866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd29816b20 0x55fd29825c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 -- 172.21.15.5:0/103088866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd2980c380 msgr2=0x55fd29807f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/103088866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd2980c380 0x55fd29807f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 -- 172.21.15.5:0/103088866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2980b2f0 con 0x55fd297e3e80 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/103088866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e3e80 0x55fd297e4450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c001810 tx=0x7f3b3c009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbea03e691a82a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b3a600640 1 -- 172.21.15.5:0/103088866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c044040 con 0x55fd297e3e80 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b3a600640 1 -- 172.21.15.5:0/103088866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c007690 con 0x55fd297e3e80 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.461+0000 7f3b3a600640 1 -- 172.21.15.5:0/103088866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0069d0 con 0x55fd297e3e80 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 -- 172.21.15.5:0/103088866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e3e80 msgr2=0x55fd297e4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 --2- 172.21.15.5:0/103088866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e3e80 0x55fd297e4450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c001810 tx=0x7f3b3c009030 comp rx=0 tx=0).stop 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 -- 172.21.15.5:0/103088866 shutdown_connections 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 --2- 172.21.15.5:0/103088866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd29816b20 0x55fd29825c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 --2- 172.21.15.5:0/103088866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd2980c380 0x55fd29807f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 --2- 172.21.15.5:0/103088866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd297e3e80 0x55fd297e4450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 -- 172.21.15.5:0/103088866 >> 172.21.15.5:0/103088866 conn(0x55fd29778d10 msgr2=0x55fd297de620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 -- 172.21.15.5:0/103088866 shutdown_connections 2024-04-26T21:37:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.462+0000 7f3b54449740 1 -- 172.21.15.5:0/103088866 wait complete. 2024-04-26T21:37:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.463+0000 7f3b54449740 1 -- start start 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.463+0000 7f3b54449740 1 Processor -- start 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29807f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b54449740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd2982c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b54449740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd2982c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b54449740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fd298169a0 con 0x55fd2980c380 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fd2980f820 con 0x55fd29816b20 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b54449740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55fd2988d2f0 con 0x55fd297e3e80 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b54449740 10 client.0 _ll_register_callbacks cb 0x7f3b34005a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd2982c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd2982c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55614/0 (socket says 172.21.15.5:55614) 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 -- 172.21.15.5:0/17615192 learned_addr learned my addr 172.21.15.5:0/17615192 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29807f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b4b400640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd2982c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 -- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 msgr2=0x55fd29807f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29807f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 -- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 msgr2=0x55fd2982c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd2982c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.464+0000 7f3b43e00640 1 -- 172.21.15.5:0/17615192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd29829c70 con 0x55fd2980c380 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b4b400640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd2982c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b43e00640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd2982c340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3b34013e80 tx=0x7f3b34001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcbaff58bef4592 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b2f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b2f400640 1 -- 172.21.15.5:0/17615192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3403a060 con 0x55fd2980c380 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c007690 con 0x55fd2980c380 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b2f400640 1 -- 172.21.15.5:0/17615192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3b34028e00 con 0x55fd2980c380 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b2f400640 1 -- 172.21.15.5:0/17615192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3b340047e0 con 0x55fd2980c380 2024-04-26T21:37:54.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b54449740 10 client.4773 fetch_fsmap learned FSMap version 9 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.465+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55fd29808460 con 0x55fd2980c380 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b2f400640 1 -- 172.21.15.5:0/17615192 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c007690 con 0x55fd2980c380 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b2f400640 1 -- 172.21.15.5:0/17615192 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 9) ==== 2292+0+0 (secure 0 0 0) 0x7f3b34030040 con 0x55fd2980c380 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b54449740 10 client.4773 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b54449740 10 client.4773 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b54449740 20 client.4773 populate_metadata read hostname 'smithi005' 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b54449740 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd29890200 0x55fd298905e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b54449740 4 client.4773 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 --> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] -- command(tid 0: {"prefix": "status"}) -- 0x55fd29750080 con 0x55fd29890200 2024-04-26T21:37:54.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.466+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd29890200 0x55fd298905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.467+0000 7f3b4aa00640 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd29890200 0x55fd298905e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8068b9263506463e server_cookie=14b4a737edca5514 in_seq=0 out_seq=0 2024-04-26T21:37:54.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.467+0000 7f3b2f400640 10 client.4773 ms_handle_connect on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b2f400640 1 -- 172.21.15.5:0/17615192 <== mds.0 v2:172.21.15.112:6834/1466535528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55fd29750080 con 0x55fd29890200 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b2f400640 10 client.4773 handle_command_reply: tid=0 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 client.4773 shutdown 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 msgr2=0x55fd2982c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd2982c340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3b34013e80 tx=0x7f3b34001150 comp rx=0 tx=0).stop 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 shutdown_connections 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:6834/1466535528,v1:172.21.15.112:6835/1466535528] conn(0x55fd29890200 0x55fd298905e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd29816b20 0x55fd2982c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fd2980c380 0x55fd2982c340 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 --2- 172.21.15.5:0/17615192 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fd297e3e80 0x55fd29807f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b2f400640 0 client.4773 ms_handle_reset on v2:172.21.15.112:6834/1466535528 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.468+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 >> 172.21.15.5:0/17615192 conn(0x55fd29778d10 msgr2=0x55fd297dfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 shutdown_connections 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b54449740 1 -- 172.21.15.5:0/17615192 wait complete. 2024-04-26T21:37:54.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b54449740 20 client.4773 trim_cache size 0 max 16384 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "a3a415d8-7c54-4abb-9c5e-72229b6eddf5", 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4294, 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 37.060055337000001, 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 9, 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 24, 2024-04-26T21:37:54.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T21:37:54.474 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 42.895224075999998 2024-04-26T21:37:54.474 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T21:37:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3b2806c8f0 msgr2=0x7f3b2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3b2806c8f0 0x7f3b2806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c032000 tx=0x7f3b3c02c000 comp rx=0 tx=0).stop 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4c145d80 msgr2=0x7f3b4c1e2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4c145d80 0x7f3b4c1e2000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0b9bc0 tx=0x7f3b440115a0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 shutdown_connections 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f3b2806c8f0 0x7f3b2806edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4c145d80 0x7f3b4c1e2000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b4c1494e0 0x7f3b4c145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 --2- 172.21.15.5:0/3157345707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b300039b0 0x7f3b4c148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.469+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 >> 172.21.15.5:0/3157345707 conn(0x7f3b4c068270 msgr2=0x7f3b4c0be440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.470+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 shutdown_connections 2024-04-26T21:37:54.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.470+0000 7f3b51600640 1 -- 172.21.15.5:0/3157345707 wait complete. 2024-04-26T21:37:54.488 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T21:37:54.498 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T21:37:54.498 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T21:37:54.499 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T21:37:54.499 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T21:37:54.508 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T21:37:54.508 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T21:37:54.508 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T21:37:54.508 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:37:54.508 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:54.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:54.509 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-26T21:37:54.565 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T21:37:54.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:54.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:37:54.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:54.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-26T21:37:54.782 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T21:37:54.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:37:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.965+0000 7f4635000640 1 Processor -- start 2024-04-26T21:37:54.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.965+0000 7f4635000640 1 -- start start 2024-04-26T21:37:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f4635000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46300afb00 0x7f46300b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f4635000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46300b4d20 0x7f46300b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f4635000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46300b7240 con 0x7f46300b6e60 2024-04-26T21:37:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f4635000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f46300af670 con 0x7f46300afb00 2024-04-26T21:37:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f4635000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f46300b5d90 con 0x7f46300b4d20 2024-04-26T21:37:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f4627e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46300afb00 0x7f46300b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f462f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f46300b6e60 0x7f46300b0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48894/0 (socket says 172.21.15.5:48894) 2024-04-26T21:37:54.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.966+0000 7f462f400640 1 -- 172.21.15.5:0/1002702679 learned_addr learned my addr 172.21.15.5:0/1002702679 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T21:37:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.967+0000 7f462fe00640 1 --2- 172.21.15.5:0/1002702679 >> v2:172.21.15.112:3300/0 conn(0x7f46300b4d20 0x7f46300b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.967+0000 7f4627e00640 1 -- 172.21.15.5:0/1002702679 >> v2:172.21.15.112:3300/0 conn(0x7f46300b4d20 msgr2=0x7f46300b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:37:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.967+0000 7f4627e00640 1 --2- 172.21.15.5:0/1002702679 >> v2:172.21.15.112:3300/0 conn(0x7f46300b4d20 0x7f46300b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.967+0000 7f4627e00640 1 -- 172.21.15.5:0/1002702679 >> v1:172.21.15.5:6789/0 conn(0x7f46300b6e60 legacy=0x7f46300b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.967+0000 7f4627e00640 1 -- 172.21.15.5:0/1002702679 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46300b6070 con 0x7f46300afb00 2024-04-26T21:37:54.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.967+0000 7f462ea00640 1 -- 172.21.15.5:0/1002702679 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906945820 0 0) 0x7f46300b7240 con 0x7f46300b6e60 2024-04-26T21:37:54.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.968+0000 7f4627e00640 1 --2- 172.21.15.5:0/1002702679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46300b43e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46300b5870 tx=0x7f461802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6be8927d346eccc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.968+0000 7f462ea00640 1 -- 172.21.15.5:0/1002702679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4618037070 con 0x7f46300afb00 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.968+0000 7f462ea00640 1 -- 172.21.15.5:0/1002702679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4618032440 con 0x7f46300afb00 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.968+0000 7f462ea00640 1 -- 172.21.15.5:0/1002702679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4618032810 con 0x7f46300afb00 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 -- 172.21.15.5:0/1002702679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 msgr2=0x7f46300b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 --2- 172.21.15.5:0/1002702679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46300b43e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46300b5870 tx=0x7f461802a1a0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 -- 172.21.15.5:0/1002702679 shutdown_connections 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 --2- 172.21.15.5:0/1002702679 >> v2:172.21.15.112:3300/0 conn(0x7f46300b4d20 0x7f46300b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 --2- 172.21.15.5:0/1002702679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46300b43e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 -- 172.21.15.5:0/1002702679 >> 172.21.15.5:0/1002702679 conn(0x7f46300ba0f0 msgr2=0x7f46300b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 -- 172.21.15.5:0/1002702679 shutdown_connections 2024-04-26T21:37:54.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.969+0000 7f4635000640 1 -- 172.21.15.5:0/1002702679 wait complete. 2024-04-26T21:37:54.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.971+0000 7f4635000640 1 Processor -- start 2024-04-26T21:37:54.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.971+0000 7f4635000640 1 -- start start 2024-04-26T21:37:54.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f4635000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46301e1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f4635000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46300b4d20 0x7f4630150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f4635000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46300b6e60 0x7f4630150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f4635000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4630074010 con 0x7f46300afb00 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f4635000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4630073e90 con 0x7f46300b6e60 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f4635000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4630152d70 con 0x7f46300b4d20 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46301e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46301e1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55624/0 (socket says 172.21.15.5:55624) 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 -- 172.21.15.5:0/543621468 learned_addr learned my addr 172.21.15.5:0/543621468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462fe00640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46300b6e60 0x7f4630150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f4627e00640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46300b4d20 0x7f4630150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 -- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46300b4d20 msgr2=0x7f4630150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46300b4d20 0x7f4630150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 -- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46300b6e60 msgr2=0x7f4630150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46300b6e60 0x7f4630150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462f400640 1 -- 172.21.15.5:0/543621468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46300b43a0 con 0x7f46300afb00 2024-04-26T21:37:54.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.972+0000 7f462fe00640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46300b6e60 0x7f4630150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:37:54.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.973+0000 7f462f400640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46301e1590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f462000c430 tx=0x7f462000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.973+0000 7f4627400640 1 -- 172.21.15.5:0/543621468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46200074e0 con 0x7f46300afb00 2024-04-26T21:37:54.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.973+0000 7f4627400640 1 -- 172.21.15.5:0/543621468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46200047e0 con 0x7f46300afb00 2024-04-26T21:37:54.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.973+0000 7f4627400640 1 -- 172.21.15.5:0/543621468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620004bd0 con 0x7f46300afb00 2024-04-26T21:37:54.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.973+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46301e1c70 con 0x7f46300afb00 2024-04-26T21:37:54.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.973+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4630152310 con 0x7f46300afb00 2024-04-26T21:37:54.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.975+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4630075db0 con 0x7f46300afb00 2024-04-26T21:37:54.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.976+0000 7f4627400640 1 -- 172.21.15.5:0/543621468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4620011070 con 0x7f46300afb00 2024-04-26T21:37:54.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.977+0000 7f4627400640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f460c06c970 0x7f460c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:37:54.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.977+0000 7f4627400640 1 -- 172.21.15.5:0/543621468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f462008ba10 con 0x7f46300afb00 2024-04-26T21:37:54.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.977+0000 7f4627e00640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f460c06c970 0x7f460c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:37:54.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.978+0000 7f4627e00640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f460c06c970 0x7f460c06ee30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4618034000 tx=0x7f461802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:37:54.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:54.981+0000 7f4627400640 1 -- 172.21.15.5:0/543621468 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f462000e280 con 0x7f46300afb00 2024-04-26T21:37:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.224+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4630152b50 con 0x7f46300afb00 2024-04-26T21:37:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.224+0000 7f4627400640 1 -- 172.21.15.5:0/543621468 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f4620059b70 con 0x7f46300afb00 2024-04-26T21:37:55.226 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T21:37:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f460c06c970 msgr2=0x7f460c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f460c06c970 0x7f460c06ee30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4618034000 tx=0x7f461802e000 comp rx=0 tx=0).stop 2024-04-26T21:37:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 msgr2=0x7f46301e1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:37:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46301e1590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f462000c430 tx=0x7f462000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 shutdown_connections 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46300b6e60 0x7f4630150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46300b4d20 0x7f4630150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f460c06c970 0x7f460c06ee30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 --2- 172.21.15.5:0/543621468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46300afb00 0x7f46301e1590 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.227+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 >> 172.21.15.5:0/543621468 conn(0x7f46300ba0f0 msgr2=0x7f46300b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.228+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 shutdown_connections 2024-04-26T21:37:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55.228+0000 7f4635000640 1 -- 172.21.15.5:0/543621468 wait complete. 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:37:55.249 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:37:55.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:55.250 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-26T21:37:55.301 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:37:55.301 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:37:55.301 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:37:55.301 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:37:55.301 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-26T21:37:55.301 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42619sec preferred_lft 42619sec 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-26T21:37:55.302 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:37:55.303 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:37:55.303 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:37:55.303 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-26T21:37:55.304 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:37:55.304 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:55.304 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:55.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:37:55.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-04-26T21:37:55.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-04-26T21:37:55.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:37:55.304 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:55.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:55.561 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:37:55.623 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-26T21:37:55.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:55.627 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-26T21:37:55.674 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-26T21:37:55.674 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:37:55.674 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T21:37:55.674 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T21:37:55.674 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:37:55.674 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:55.674 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:55.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T21:37:55.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T21:37:55.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T21:37:55.675 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:55.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:55.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:55.898 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-26T21:37:55.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:55.948 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-04-26T21:37:55.997 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:55.997 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:55.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:37:55.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T21:37:55.997 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:56.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:56.180 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T21:37:56.180 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:56.180 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:56.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T21:37:56.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:37:56.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T21:37:56.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T21:37:56.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T21:37:56.181 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:56.456 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:37:56.456 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-26T21:37:56.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-26T21:37:56.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:37:56.456 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-26T21:37:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:37:56.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:56.667 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T21:37:56.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:37:56.668 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:56.709 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:37:56.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:37:56.709 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:56.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-04-26T21:37:56.881 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:37:56.937 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-04-26T21:37:56.937 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-04-26T21:37:56.937 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-04-26T21:37:56.938 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:37:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:37:56.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:56.941 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-04-26T21:37:56.992 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:37:56.992 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T21:37:56.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-04-26T21:37:57.067 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-04-26T21:37:57.108 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T21:37:57.109 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:37:57.110 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:37:57.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:57.111 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-04-26T21:37:57.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-04-26T21:37:57.168+0000 7fdf0c11a480 -1 init, newargv = 0x558c42b49060 newargc=15 2024-04-26T21:37:57.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[41727]: starting ceph client 2024-04-26T21:37:57.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[41727]: starting fuse 2024-04-26T21:37:57.197 INFO:teuthology.orchestra.run.smithi005.stdout:40 2024-04-26T21:37:57.197 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-04-26T21:37:57.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:37:57.197 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-04-26T21:37:57.197 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-04-26T21:37:57.198 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-04-26T21:37:57.199 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-26T21:37:57.381 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.41727.asok 2024-04-26T21:37:57.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T21:37:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:37:57.398 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41727.asok 2024-04-26T21:37:57.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:57.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41727.asok status 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T21:37:57.620 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "41727", 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4788, 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4788 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-04-26T21:37:57.621 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3943732051 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3943732051 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4788 192.168.0.1:0/3943732051", 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/3943732051", 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 9, 2024-04-26T21:37:57.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 24, 2024-04-26T21:37:57.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:37:57.623 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-04-26T21:37:57.623 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-04-26T21:37:57.623 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T21:37:57.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:57.635 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-04-26T21:37:57.635 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:57.685 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-04-26T21:37:57.686 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:57.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:37:57.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:57.757 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T21:37:57.771 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:37:57.771 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T21:37:57.771 INFO:tasks.workunit:timeout=3h 2024-04-26T21:37:57.771 INFO:tasks.workunit:cleanup=True 2024-04-26T21:37:57.771 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-26 21:37:17.411862391 +0000 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-26 21:37:30.845691559 +0000 2024-04-26T21:37:57.809 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-04-26T21:37:57.810 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T21:37:57.810 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T21:37:57.934 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:37:57.984 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T21:38:13.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:38:13.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:38:43.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:38:43.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:39:13.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:39:13.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:39:25.379 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 59% (7279/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 97% (12006/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-04-26T21:39:26.105 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-26T21:39:26.106 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-04-26T21:39:26.106 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-26T21:39:26.106 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-04-26T21:39:26.106 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-26T21:39:26.106 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T21:39:26.106 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-26T21:39:26.106 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T21:39:26.118 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T21:39:26.180 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T21:39:26.185 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T21:39:26.185 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T21:39:26.949 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T21:39:27.061 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T21:39:27.143 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T21:39:27.150 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T21:39:27.150 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T21:39:27.237 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T21:39:27.247 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T21:39:27.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T21:39:27.300 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-04-26T21:39:27.301 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-04-26T21:39:27.301 DEBUG:teuthology.orchestra.run.smithi005:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-04-26T21:39:27.392 INFO:tasks.workunit.client.0.smithi005.stderr:+ dbench 1 2024-04-26T21:39:27.405 INFO:tasks.workunit.client.0.smithi005.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-26T21:39:27.406 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-04-26T21:39:27.406 INFO:tasks.workunit.client.0.smithi005.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-26T21:39:27.409 INFO:tasks.workunit.client.0.smithi005.stdout:0 of 1 processes prepared for launch 0 sec 2024-04-26T21:39:27.509 INFO:tasks.workunit.client.0.smithi005.stdout:1 of 1 processes prepared for launch 0 sec 2024-04-26T21:39:27.509 INFO:tasks.workunit.client.0.smithi005.stdout:releasing clients 2024-04-26T21:39:28.510 INFO:tasks.workunit.client.0.smithi005.stdout: 1 244 9.27 MB/sec warmup 1 sec latency 36.537 ms 2024-04-26T21:39:29.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 453 7.95 MB/sec warmup 2 sec latency 37.194 ms 2024-04-26T21:39:30.510 INFO:tasks.workunit.client.0.smithi005.stdout: 1 682 7.06 MB/sec warmup 3 sec latency 45.419 ms 2024-04-26T21:39:31.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 849 5.39 MB/sec warmup 4 sec latency 45.399 ms 2024-04-26T21:39:32.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 969 4.36 MB/sec warmup 5 sec latency 46.510 ms 2024-04-26T21:39:33.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1115 3.83 MB/sec warmup 6 sec latency 47.683 ms 2024-04-26T21:39:34.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1246 3.30 MB/sec warmup 7 sec latency 50.301 ms 2024-04-26T21:39:35.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1441 3.25 MB/sec warmup 8 sec latency 54.355 ms 2024-04-26T21:39:36.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1574 2.90 MB/sec warmup 9 sec latency 47.736 ms 2024-04-26T21:39:37.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1705 2.62 MB/sec warmup 10 sec latency 52.415 ms 2024-04-26T21:39:38.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1864 2.40 MB/sec warmup 11 sec latency 47.701 ms 2024-04-26T21:39:39.511 INFO:tasks.workunit.client.0.smithi005.stdout: 1 2034 2.21 MB/sec warmup 12 sec latency 54.311 ms 2024-04-26T21:39:40.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 2175 2.06 MB/sec warmup 13 sec latency 48.610 ms 2024-04-26T21:39:41.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 2337 1.99 MB/sec warmup 14 sec latency 50.352 ms 2024-04-26T21:39:42.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 2440 1.87 MB/sec warmup 15 sec latency 49.374 ms 2024-04-26T21:39:43.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:39:43.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:39:43.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 2581 1.81 MB/sec warmup 16 sec latency 46.032 ms 2024-04-26T21:39:44.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 2874 1.89 MB/sec warmup 17 sec latency 46.041 ms 2024-04-26T21:39:45.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3017 1.86 MB/sec warmup 18 sec latency 45.055 ms 2024-04-26T21:39:46.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3286 1.86 MB/sec warmup 19 sec latency 50.454 ms 2024-04-26T21:39:47.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3318 1.77 MB/sec warmup 20 sec latency 54.347 ms 2024-04-26T21:39:48.512 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3366 1.69 MB/sec warmup 21 sec latency 50.613 ms 2024-04-26T21:39:49.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3582 1.75 MB/sec warmup 22 sec latency 51.513 ms 2024-04-26T21:39:50.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3758 1.73 MB/sec warmup 23 sec latency 54.531 ms 2024-04-26T21:39:51.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3839 1.66 MB/sec warmup 24 sec latency 43.109 ms 2024-04-26T21:39:52.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3928 1.60 MB/sec warmup 25 sec latency 47.296 ms 2024-04-26T21:39:53.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4010 1.54 MB/sec warmup 26 sec latency 31.504 ms 2024-04-26T21:39:54.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4103 1.48 MB/sec warmup 27 sec latency 58.952 ms 2024-04-26T21:39:55.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4226 1.44 MB/sec warmup 28 sec latency 66.243 ms 2024-04-26T21:39:56.513 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4386 1.40 MB/sec warmup 29 sec latency 48.620 ms 2024-04-26T21:39:57.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4511 1.36 MB/sec warmup 30 sec latency 64.424 ms 2024-04-26T21:39:58.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4668 1.36 MB/sec warmup 31 sec latency 48.442 ms 2024-04-26T21:39:59.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4797 1.32 MB/sec warmup 32 sec latency 51.141 ms 2024-04-26T21:40:00.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 4985 1.37 MB/sec warmup 33 sec latency 53.358 ms 2024-04-26T21:40:01.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5123 1.33 MB/sec warmup 34 sec latency 45.057 ms 2024-04-26T21:40:02.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5266 1.30 MB/sec warmup 35 sec latency 51.306 ms 2024-04-26T21:40:03.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5424 1.26 MB/sec warmup 36 sec latency 49.606 ms 2024-04-26T21:40:04.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5591 1.23 MB/sec warmup 37 sec latency 50.893 ms 2024-04-26T21:40:05.514 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5726 1.21 MB/sec warmup 38 sec latency 55.835 ms 2024-04-26T21:40:06.515 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5893 1.20 MB/sec warmup 39 sec latency 49.847 ms 2024-04-26T21:40:07.515 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5991 1.18 MB/sec warmup 40 sec latency 48.982 ms 2024-04-26T21:40:08.515 INFO:tasks.workunit.client.0.smithi005.stdout: 1 6134 1.17 MB/sec warmup 41 sec latency 52.343 ms 2024-04-26T21:40:09.515 INFO:tasks.workunit.client.0.smithi005.stdout: 1 6332 1.22 MB/sec warmup 42 sec latency 51.413 ms 2024-04-26T21:40:10.515 INFO:tasks.workunit.client.0.smithi005.stdout: 1 6549 1.22 MB/sec warmup 43 sec latency 48.933 ms 2024-04-26T21:40:11.515 INFO:tasks.workunit.client.0.smithi005.stdout: 1 6836 1.24 MB/sec warmup 44 sec latency 68.009 ms 2024-04-26T21:40:12.515 INFO:tasks.workunit.client.0.smithi005.stdout: 1 6869 1.21 MB/sec warmup 45 sec latency 49.139 ms 2024-04-26T21:40:13.516 INFO:tasks.workunit.client.0.smithi005.stdout: 1 6906 1.18 MB/sec warmup 46 sec latency 54.091 ms 2024-04-26T21:40:13.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:40:13.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:40:14.516 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7060 1.22 MB/sec warmup 47 sec latency 309.288 ms 2024-04-26T21:40:15.516 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7190 1.20 MB/sec warmup 48 sec latency 349.142 ms 2024-04-26T21:40:16.516 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7333 1.20 MB/sec warmup 49 sec latency 45.148 ms 2024-04-26T21:40:17.516 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7412 1.18 MB/sec warmup 50 sec latency 29.823 ms 2024-04-26T21:40:18.516 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7499 1.16 MB/sec warmup 51 sec latency 51.398 ms 2024-04-26T21:40:19.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7579 1.14 MB/sec warmup 52 sec latency 54.330 ms 2024-04-26T21:40:20.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7691 1.12 MB/sec warmup 53 sec latency 51.019 ms 2024-04-26T21:40:21.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7812 1.10 MB/sec warmup 54 sec latency 52.203 ms 2024-04-26T21:40:22.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 7968 1.09 MB/sec warmup 55 sec latency 45.450 ms 2024-04-26T21:40:23.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 8105 1.07 MB/sec warmup 56 sec latency 48.391 ms 2024-04-26T21:40:24.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 8254 1.07 MB/sec warmup 57 sec latency 46.616 ms 2024-04-26T21:40:25.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 8384 1.06 MB/sec warmup 58 sec latency 46.743 ms 2024-04-26T21:40:26.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 8572 1.09 MB/sec warmup 59 sec latency 49.450 ms 2024-04-26T21:40:27.517 INFO:tasks.workunit.client.0.smithi005.stdout: 1 8709 1.07 MB/sec warmup 60 sec latency 46.183 ms 2024-04-26T21:40:28.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 8875 1.06 MB/sec warmup 61 sec latency 45.359 ms 2024-04-26T21:40:29.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 9001 1.04 MB/sec warmup 62 sec latency 54.172 ms 2024-04-26T21:40:30.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 9159 1.03 MB/sec warmup 63 sec latency 52.259 ms 2024-04-26T21:40:31.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 9304 1.02 MB/sec warmup 64 sec latency 45.788 ms 2024-04-26T21:40:32.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 9466 1.02 MB/sec warmup 65 sec latency 48.659 ms 2024-04-26T21:40:33.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 9571 1.01 MB/sec warmup 66 sec latency 47.360 ms 2024-04-26T21:40:34.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 9708 1.00 MB/sec warmup 67 sec latency 47.509 ms 2024-04-26T21:40:35.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10002 1.04 MB/sec warmup 68 sec latency 51.109 ms 2024-04-26T21:40:36.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10269 1.05 MB/sec warmup 69 sec latency 50.284 ms 2024-04-26T21:40:37.518 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10392 1.05 MB/sec warmup 70 sec latency 52.758 ms 2024-04-26T21:40:38.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10422 1.04 MB/sec warmup 71 sec latency 52.725 ms 2024-04-26T21:40:39.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10492 1.02 MB/sec warmup 72 sec latency 48.840 ms 2024-04-26T21:40:40.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10725 1.05 MB/sec warmup 73 sec latency 48.549 ms 2024-04-26T21:40:41.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10870 1.05 MB/sec warmup 74 sec latency 47.773 ms 2024-04-26T21:40:42.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 10952 1.04 MB/sec warmup 75 sec latency 31.083 ms 2024-04-26T21:40:43.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11041 1.03 MB/sec warmup 76 sec latency 43.707 ms 2024-04-26T21:40:44.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11122 1.02 MB/sec warmup 77 sec latency 46.160 ms 2024-04-26T21:40:44.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:40:44.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:40:45.519 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11238 1.00 MB/sec warmup 78 sec latency 54.706 ms 2024-04-26T21:40:46.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11365 0.99 MB/sec warmup 79 sec latency 54.489 ms 2024-04-26T21:40:47.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11516 0.99 MB/sec warmup 80 sec latency 53.263 ms 2024-04-26T21:40:48.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11652 0.98 MB/sec warmup 81 sec latency 53.978 ms 2024-04-26T21:40:49.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11803 0.98 MB/sec warmup 82 sec latency 51.394 ms 2024-04-26T21:40:50.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11934 0.97 MB/sec warmup 83 sec latency 46.368 ms 2024-04-26T21:40:51.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 12118 0.99 MB/sec warmup 84 sec latency 53.644 ms 2024-04-26T21:40:52.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 12252 0.98 MB/sec warmup 85 sec latency 46.765 ms 2024-04-26T21:40:53.520 INFO:tasks.workunit.client.0.smithi005.stdout: 1 12413 0.97 MB/sec warmup 86 sec latency 49.177 ms 2024-04-26T21:40:54.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 12550 0.96 MB/sec warmup 87 sec latency 46.824 ms 2024-04-26T21:40:55.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 12710 0.95 MB/sec warmup 88 sec latency 46.310 ms 2024-04-26T21:40:56.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 12853 0.95 MB/sec warmup 89 sec latency 46.919 ms 2024-04-26T21:40:57.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 13016 0.95 MB/sec warmup 90 sec latency 48.804 ms 2024-04-26T21:40:58.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 13124 0.94 MB/sec warmup 91 sec latency 49.368 ms 2024-04-26T21:40:59.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 13259 0.94 MB/sec warmup 92 sec latency 49.172 ms 2024-04-26T21:41:00.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 13551 0.97 MB/sec warmup 93 sec latency 51.341 ms 2024-04-26T21:41:01.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 13817 0.97 MB/sec warmup 94 sec latency 50.094 ms 2024-04-26T21:41:02.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 13941 0.98 MB/sec warmup 95 sec latency 57.101 ms 2024-04-26T21:41:03.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 13972 0.97 MB/sec warmup 96 sec latency 49.153 ms 2024-04-26T21:41:04.521 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14040 0.96 MB/sec warmup 97 sec latency 54.077 ms 2024-04-26T21:41:05.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14275 0.98 MB/sec warmup 98 sec latency 45.940 ms 2024-04-26T21:41:06.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14415 0.98 MB/sec warmup 99 sec latency 46.958 ms 2024-04-26T21:41:07.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14498 0.97 MB/sec warmup 100 sec latency 28.785 ms 2024-04-26T21:41:08.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14583 0.96 MB/sec warmup 101 sec latency 51.217 ms 2024-04-26T21:41:09.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14667 0.96 MB/sec warmup 102 sec latency 51.342 ms 2024-04-26T21:41:10.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14771 0.95 MB/sec warmup 103 sec latency 54.829 ms 2024-04-26T21:41:11.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14891 0.94 MB/sec warmup 104 sec latency 52.268 ms 2024-04-26T21:41:12.522 INFO:tasks.workunit.client.0.smithi005.stdout: 1 15059 0.93 MB/sec warmup 105 sec latency 46.135 ms 2024-04-26T21:41:13.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 15188 0.93 MB/sec warmup 106 sec latency 60.932 ms 2024-04-26T21:41:14.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 15329 0.93 MB/sec warmup 107 sec latency 53.818 ms 2024-04-26T21:41:14.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:41:14.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:41:15.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 15458 0.92 MB/sec warmup 108 sec latency 51.269 ms 2024-04-26T21:41:16.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 15650 0.94 MB/sec warmup 109 sec latency 55.199 ms 2024-04-26T21:41:17.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 15786 0.93 MB/sec warmup 110 sec latency 47.242 ms 2024-04-26T21:41:18.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 15918 0.93 MB/sec warmup 111 sec latency 50.799 ms 2024-04-26T21:41:19.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 16070 0.92 MB/sec warmup 112 sec latency 50.452 ms 2024-04-26T21:41:20.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 16249 0.91 MB/sec warmup 113 sec latency 46.930 ms 2024-04-26T21:41:21.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 16378 0.91 MB/sec warmup 114 sec latency 52.748 ms 2024-04-26T21:41:22.523 INFO:tasks.workunit.client.0.smithi005.stdout: 1 16544 0.91 MB/sec warmup 115 sec latency 52.761 ms 2024-04-26T21:41:23.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 16643 0.90 MB/sec warmup 116 sec latency 47.566 ms 2024-04-26T21:41:24.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 16791 0.90 MB/sec warmup 117 sec latency 45.682 ms 2024-04-26T21:41:25.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 17072 0.92 MB/sec warmup 118 sec latency 45.916 ms 2024-04-26T21:41:26.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 17215 0.92 MB/sec warmup 119 sec latency 48.767 ms 2024-04-26T21:41:28.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 17511 0.02 MB/sec execute 1 sec latency 57.806 ms 2024-04-26T21:41:29.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 17568 0.06 MB/sec execute 2 sec latency 50.307 ms 2024-04-26T21:41:30.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 17764 1.03 MB/sec execute 3 sec latency 114.756 ms 2024-04-26T21:41:31.524 INFO:tasks.workunit.client.0.smithi005.stdout: 1 17943 1.10 MB/sec execute 4 sec latency 43.851 ms 2024-04-26T21:41:32.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18026 0.88 MB/sec execute 5 sec latency 33.931 ms 2024-04-26T21:41:33.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18118 0.79 MB/sec execute 6 sec latency 48.525 ms 2024-04-26T21:41:34.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18198 0.67 MB/sec execute 7 sec latency 38.276 ms 2024-04-26T21:41:35.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18291 0.59 MB/sec execute 8 sec latency 50.251 ms 2024-04-26T21:41:36.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18410 0.54 MB/sec execute 9 sec latency 56.670 ms 2024-04-26T21:41:37.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18567 0.53 MB/sec execute 10 sec latency 54.711 ms 2024-04-26T21:41:38.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18695 0.51 MB/sec execute 11 sec latency 53.749 ms 2024-04-26T21:41:39.525 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18843 0.56 MB/sec execute 12 sec latency 50.588 ms 2024-04-26T21:41:40.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 18965 0.53 MB/sec execute 13 sec latency 51.320 ms 2024-04-26T21:41:41.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 19163 0.70 MB/sec execute 14 sec latency 49.505 ms 2024-04-26T21:41:42.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 19303 0.66 MB/sec execute 15 sec latency 47.720 ms 2024-04-26T21:41:43.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 19439 0.62 MB/sec execute 16 sec latency 44.831 ms 2024-04-26T21:41:44.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 19600 0.60 MB/sec execute 17 sec latency 51.038 ms 2024-04-26T21:41:44.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:41:44.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:41:45.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 19777 0.57 MB/sec execute 18 sec latency 44.381 ms 2024-04-26T21:41:46.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 19908 0.55 MB/sec execute 19 sec latency 55.650 ms 2024-04-26T21:41:47.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 20106 0.58 MB/sec execute 20 sec latency 51.664 ms 2024-04-26T21:41:48.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 20201 0.57 MB/sec execute 21 sec latency 48.713 ms 2024-04-26T21:41:49.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 20343 0.58 MB/sec execute 22 sec latency 46.206 ms 2024-04-26T21:41:50.526 INFO:tasks.workunit.client.0.smithi005.stdout: 1 20540 0.69 MB/sec execute 23 sec latency 108.493 ms 2024-04-26T21:41:51.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 20757 0.72 MB/sec execute 24 sec latency 45.094 ms 2024-04-26T21:41:52.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21047 0.77 MB/sec execute 25 sec latency 54.024 ms 2024-04-26T21:41:53.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21088 0.74 MB/sec execute 26 sec latency 48.555 ms 2024-04-26T21:41:54.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21114 0.71 MB/sec execute 27 sec latency 51.797 ms 2024-04-26T21:41:55.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21323 0.79 MB/sec execute 28 sec latency 54.786 ms 2024-04-26T21:41:56.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21463 0.78 MB/sec execute 29 sec latency 51.175 ms 2024-04-26T21:41:57.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21589 0.79 MB/sec execute 30 sec latency 48.157 ms 2024-04-26T21:41:58.527 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21676 0.77 MB/sec execute 31 sec latency 49.916 ms 2024-04-26T21:41:59.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21762 0.75 MB/sec execute 32 sec latency 42.209 ms 2024-04-26T21:42:00.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21840 0.72 MB/sec execute 33 sec latency 46.899 ms 2024-04-26T21:42:01.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 21951 0.70 MB/sec execute 34 sec latency 52.349 ms 2024-04-26T21:42:02.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22116 0.69 MB/sec execute 35 sec latency 50.924 ms 2024-04-26T21:42:03.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22262 0.69 MB/sec execute 36 sec latency 49.468 ms 2024-04-26T21:42:04.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22400 0.70 MB/sec execute 37 sec latency 44.725 ms 2024-04-26T21:42:05.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22535 0.68 MB/sec execute 38 sec latency 50.436 ms 2024-04-26T21:42:06.528 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22728 0.74 MB/sec execute 39 sec latency 53.536 ms 2024-04-26T21:42:07.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22857 0.73 MB/sec execute 40 sec latency 52.419 ms 2024-04-26T21:42:08.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22985 0.71 MB/sec execute 41 sec latency 49.712 ms 2024-04-26T21:42:09.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 23162 0.70 MB/sec execute 42 sec latency 45.813 ms 2024-04-26T21:42:10.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 23308 0.68 MB/sec execute 43 sec latency 45.304 ms 2024-04-26T21:42:11.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 23464 0.67 MB/sec execute 44 sec latency 49.952 ms 2024-04-26T21:42:12.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 23632 0.68 MB/sec execute 45 sec latency 50.653 ms 2024-04-26T21:42:13.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 23727 0.67 MB/sec execute 46 sec latency 51.306 ms 2024-04-26T21:42:14.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 23875 0.68 MB/sec execute 47 sec latency 45.731 ms 2024-04-26T21:42:15.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:42:15.090 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:42:15.529 INFO:tasks.workunit.client.0.smithi005.stdout: 1 24076 0.73 MB/sec execute 48 sec latency 51.235 ms 2024-04-26T21:42:16.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 24297 0.74 MB/sec execute 49 sec latency 52.019 ms 2024-04-26T21:42:17.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 24555 0.75 MB/sec execute 50 sec latency 61.866 ms 2024-04-26T21:42:18.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 24630 0.75 MB/sec execute 51 sec latency 52.074 ms 2024-04-26T21:42:19.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 24656 0.74 MB/sec execute 52 sec latency 52.068 ms 2024-04-26T21:42:20.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 24852 0.78 MB/sec execute 53 sec latency 46.018 ms 2024-04-26T21:42:21.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 24998 0.77 MB/sec execute 54 sec latency 51.880 ms 2024-04-26T21:42:22.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25126 0.78 MB/sec execute 55 sec latency 44.315 ms 2024-04-26T21:42:23.530 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25211 0.77 MB/sec execute 56 sec latency 52.527 ms 2024-04-26T21:42:24.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25297 0.75 MB/sec execute 57 sec latency 45.426 ms 2024-04-26T21:42:25.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25376 0.74 MB/sec execute 58 sec latency 50.011 ms 2024-04-26T21:42:26.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25491 0.73 MB/sec execute 59 sec latency 48.740 ms 2024-04-26T21:42:27.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25633 0.72 MB/sec execute 60 sec latency 55.437 ms 2024-04-26T21:42:28.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25787 0.72 MB/sec execute 61 sec latency 53.288 ms 2024-04-26T21:42:29.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25929 0.73 MB/sec execute 62 sec latency 55.265 ms 2024-04-26T21:42:30.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 26051 0.72 MB/sec execute 63 sec latency 52.732 ms 2024-04-26T21:42:31.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 26257 0.75 MB/sec execute 64 sec latency 53.152 ms 2024-04-26T21:42:32.531 INFO:tasks.workunit.client.0.smithi005.stdout: 1 26372 0.74 MB/sec execute 65 sec latency 45.530 ms 2024-04-26T21:42:33.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 26498 0.73 MB/sec execute 66 sec latency 49.422 ms 2024-04-26T21:42:34.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 26683 0.72 MB/sec execute 67 sec latency 48.283 ms 2024-04-26T21:42:35.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 26796 0.71 MB/sec execute 68 sec latency 48.004 ms 2024-04-26T21:42:36.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 26958 0.71 MB/sec execute 69 sec latency 55.251 ms 2024-04-26T21:42:37.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 27124 0.70 MB/sec execute 70 sec latency 51.761 ms 2024-04-26T21:42:38.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 27247 0.70 MB/sec execute 71 sec latency 45.106 ms 2024-04-26T21:42:39.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 27368 0.71 MB/sec execute 72 sec latency 50.648 ms 2024-04-26T21:42:40.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 27492 0.70 MB/sec execute 73 sec latency 49.066 ms 2024-04-26T21:42:41.532 INFO:tasks.workunit.client.0.smithi005.stdout: 1 27802 0.75 MB/sec execute 74 sec latency 47.971 ms 2024-04-26T21:42:42.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28060 0.75 MB/sec execute 75 sec latency 54.862 ms 2024-04-26T21:42:43.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28168 0.76 MB/sec execute 76 sec latency 59.566 ms 2024-04-26T21:42:44.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28197 0.75 MB/sec execute 77 sec latency 55.156 ms 2024-04-26T21:42:45.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:42:45.224 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:42:45.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28375 0.77 MB/sec execute 78 sec latency 50.761 ms 2024-04-26T21:42:46.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28533 0.77 MB/sec execute 79 sec latency 45.569 ms 2024-04-26T21:42:47.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28664 0.77 MB/sec execute 80 sec latency 47.019 ms 2024-04-26T21:42:48.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28755 0.77 MB/sec execute 81 sec latency 51.717 ms 2024-04-26T21:42:49.533 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28830 0.76 MB/sec execute 82 sec latency 52.793 ms 2024-04-26T21:42:50.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28908 0.75 MB/sec execute 83 sec latency 49.378 ms 2024-04-26T21:42:51.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 29030 0.74 MB/sec execute 84 sec latency 45.249 ms 2024-04-26T21:42:52.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 29172 0.74 MB/sec execute 85 sec latency 57.467 ms 2024-04-26T21:42:53.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 29319 0.73 MB/sec execute 86 sec latency 48.402 ms 2024-04-26T21:42:54.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 29466 0.74 MB/sec execute 87 sec latency 45.884 ms 2024-04-26T21:42:55.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 29592 0.73 MB/sec execute 88 sec latency 51.541 ms 2024-04-26T21:42:56.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 29800 0.75 MB/sec execute 89 sec latency 54.439 ms 2024-04-26T21:42:57.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 29911 0.75 MB/sec execute 90 sec latency 54.082 ms 2024-04-26T21:42:58.534 INFO:tasks.workunit.client.0.smithi005.stdout: 1 30039 0.74 MB/sec execute 91 sec latency 44.543 ms 2024-04-26T21:42:59.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 30214 0.73 MB/sec execute 92 sec latency 51.980 ms 2024-04-26T21:43:00.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 30334 0.73 MB/sec execute 93 sec latency 54.355 ms 2024-04-26T21:43:01.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 30488 0.72 MB/sec execute 94 sec latency 48.509 ms 2024-04-26T21:43:02.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 30641 0.72 MB/sec execute 95 sec latency 47.735 ms 2024-04-26T21:43:03.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 30785 0.72 MB/sec execute 96 sec latency 46.524 ms 2024-04-26T21:43:04.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 30905 0.72 MB/sec execute 97 sec latency 45.710 ms 2024-04-26T21:43:05.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 31017 0.72 MB/sec execute 98 sec latency 201.555 ms 2024-04-26T21:43:06.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 31310 0.75 MB/sec execute 99 sec latency 247.427 ms 2024-04-26T21:43:07.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 31446 0.75 MB/sec execute 100 sec latency 47.486 ms 2024-04-26T21:43:08.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 31706 0.76 MB/sec execute 101 sec latency 65.082 ms 2024-04-26T21:43:09.535 INFO:tasks.workunit.client.0.smithi005.stdout: 1 31735 0.75 MB/sec execute 102 sec latency 56.863 ms 2024-04-26T21:43:10.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 31793 0.74 MB/sec execute 103 sec latency 46.669 ms 2024-04-26T21:43:11.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32025 0.77 MB/sec execute 104 sec latency 49.616 ms 2024-04-26T21:43:12.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32179 0.77 MB/sec execute 105 sec latency 45.738 ms 2024-04-26T21:43:13.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32261 0.76 MB/sec execute 106 sec latency 29.448 ms 2024-04-26T21:43:14.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32347 0.76 MB/sec execute 107 sec latency 45.896 ms 2024-04-26T21:43:15.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:43:15.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:43:15.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32434 0.75 MB/sec execute 108 sec latency 40.276 ms 2024-04-26T21:43:16.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32536 0.75 MB/sec execute 109 sec latency 49.708 ms 2024-04-26T21:43:17.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32686 0.74 MB/sec execute 110 sec latency 46.491 ms 2024-04-26T21:43:18.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 32849 0.74 MB/sec execute 111 sec latency 48.408 ms 2024-04-26T21:43:19.537 INFO:tasks.workunit.client.0.smithi005.stdout: 1 33005 0.74 MB/sec execute 112 sec latency 44.296 ms 2024-04-26T21:43:20.536 INFO:tasks.workunit.client.0.smithi005.stdout: 1 33134 0.74 MB/sec execute 113 sec latency 47.183 ms 2024-04-26T21:43:21.537 INFO:tasks.workunit.client.0.smithi005.stdout: 1 33255 0.73 MB/sec execute 114 sec latency 50.333 ms 2024-04-26T21:43:22.537 INFO:tasks.workunit.client.0.smithi005.stdout: 1 33456 0.75 MB/sec execute 115 sec latency 47.851 ms 2024-04-26T21:43:23.537 INFO:tasks.workunit.client.0.smithi005.stdout: 1 33583 0.75 MB/sec execute 116 sec latency 48.014 ms 2024-04-26T21:43:24.537 INFO:tasks.workunit.client.0.smithi005.stdout: 1 33759 0.74 MB/sec execute 117 sec latency 47.650 ms 2024-04-26T21:43:25.537 INFO:tasks.workunit.client.0.smithi005.stdout: 1 33882 0.74 MB/sec execute 118 sec latency 47.470 ms 2024-04-26T21:43:26.537 INFO:tasks.workunit.client.0.smithi005.stdout: 1 34036 0.73 MB/sec execute 119 sec latency 46.086 ms 2024-04-26T21:43:27.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 34184 0.73 MB/sec execute 120 sec latency 54.452 ms 2024-04-26T21:43:28.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 34333 0.73 MB/sec execute 121 sec latency 47.659 ms 2024-04-26T21:43:29.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 34450 0.73 MB/sec execute 122 sec latency 49.163 ms 2024-04-26T21:43:30.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 34579 0.73 MB/sec execute 123 sec latency 49.880 ms 2024-04-26T21:43:31.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 34865 0.75 MB/sec execute 124 sec latency 52.909 ms 2024-04-26T21:43:32.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35135 0.76 MB/sec execute 125 sec latency 50.632 ms 2024-04-26T21:43:33.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35255 0.76 MB/sec execute 126 sec latency 49.201 ms 2024-04-26T21:43:34.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35291 0.75 MB/sec execute 127 sec latency 52.923 ms 2024-04-26T21:43:35.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35359 0.75 MB/sec execute 128 sec latency 46.575 ms 2024-04-26T21:43:36.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35598 0.77 MB/sec execute 129 sec latency 49.933 ms 2024-04-26T21:43:37.538 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35741 0.77 MB/sec execute 130 sec latency 53.797 ms 2024-04-26T21:43:38.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35821 0.76 MB/sec execute 131 sec latency 31.494 ms 2024-04-26T21:43:39.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35910 0.76 MB/sec execute 132 sec latency 50.601 ms 2024-04-26T21:43:40.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 35989 0.75 MB/sec execute 133 sec latency 54.277 ms 2024-04-26T21:43:41.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36101 0.75 MB/sec execute 134 sec latency 48.794 ms 2024-04-26T21:43:42.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36230 0.75 MB/sec execute 135 sec latency 46.983 ms 2024-04-26T21:43:43.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36380 0.74 MB/sec execute 136 sec latency 53.332 ms 2024-04-26T21:43:44.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36518 0.74 MB/sec execute 137 sec latency 46.294 ms 2024-04-26T21:43:45.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:43:45.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:43:45.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36663 0.74 MB/sec execute 138 sec latency 47.649 ms 2024-04-26T21:43:46.539 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36795 0.74 MB/sec execute 139 sec latency 47.016 ms 2024-04-26T21:43:47.540 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36981 0.75 MB/sec execute 140 sec latency 60.160 ms 2024-04-26T21:43:48.540 INFO:tasks.workunit.client.0.smithi005.stdout: 1 37120 0.75 MB/sec execute 141 sec latency 48.519 ms 2024-04-26T21:43:49.540 INFO:tasks.workunit.client.0.smithi005.stdout: 1 37285 0.74 MB/sec execute 142 sec latency 53.054 ms 2024-04-26T21:43:50.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 37412 0.74 MB/sec execute 143 sec latency 52.045 ms 2024-04-26T21:43:51.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 37567 0.74 MB/sec execute 144 sec latency 50.880 ms 2024-04-26T21:43:52.540 INFO:tasks.workunit.client.0.smithi005.stdout: 1 37710 0.73 MB/sec execute 145 sec latency 51.754 ms 2024-04-26T21:43:53.540 INFO:tasks.workunit.client.0.smithi005.stdout: 1 37871 0.74 MB/sec execute 146 sec latency 50.806 ms 2024-04-26T21:43:54.540 INFO:tasks.workunit.client.0.smithi005.stdout: 1 37976 0.73 MB/sec execute 147 sec latency 50.743 ms 2024-04-26T21:43:55.540 INFO:tasks.workunit.client.0.smithi005.stdout: 1 38109 0.73 MB/sec execute 148 sec latency 50.017 ms 2024-04-26T21:43:56.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 38402 0.75 MB/sec execute 149 sec latency 49.147 ms 2024-04-26T21:43:57.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 38535 0.75 MB/sec execute 150 sec latency 49.657 ms 2024-04-26T21:43:58.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 38795 0.76 MB/sec execute 151 sec latency 48.893 ms 2024-04-26T21:43:59.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 38826 0.76 MB/sec execute 152 sec latency 52.307 ms 2024-04-26T21:44:00.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 38891 0.75 MB/sec execute 153 sec latency 51.696 ms 2024-04-26T21:44:01.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39124 0.77 MB/sec execute 154 sec latency 46.497 ms 2024-04-26T21:44:02.541 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39270 0.77 MB/sec execute 155 sec latency 52.606 ms 2024-04-26T21:44:03.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39349 0.76 MB/sec execute 156 sec latency 33.534 ms 2024-04-26T21:44:04.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39437 0.76 MB/sec execute 157 sec latency 49.172 ms 2024-04-26T21:44:05.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39522 0.76 MB/sec execute 158 sec latency 37.581 ms 2024-04-26T21:44:06.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39620 0.75 MB/sec execute 159 sec latency 50.477 ms 2024-04-26T21:44:07.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39750 0.75 MB/sec execute 160 sec latency 63.371 ms 2024-04-26T21:44:08.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39919 0.75 MB/sec execute 161 sec latency 58.128 ms 2024-04-26T21:44:09.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 40037 0.74 MB/sec execute 162 sec latency 50.645 ms 2024-04-26T21:44:10.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 40194 0.75 MB/sec execute 163 sec latency 47.450 ms 2024-04-26T21:44:11.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 40317 0.74 MB/sec execute 164 sec latency 48.388 ms 2024-04-26T21:44:12.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 40513 0.75 MB/sec execute 165 sec latency 51.862 ms 2024-04-26T21:44:13.542 INFO:tasks.workunit.client.0.smithi005.stdout: 1 40650 0.75 MB/sec execute 166 sec latency 45.883 ms 2024-04-26T21:44:14.543 INFO:tasks.workunit.client.0.smithi005.stdout: 1 40791 0.75 MB/sec execute 167 sec latency 44.541 ms 2024-04-26T21:44:15.543 INFO:tasks.workunit.client.0.smithi005.stdout: 1 40940 0.74 MB/sec execute 168 sec latency 50.128 ms 2024-04-26T21:44:15.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:44:15.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:44:16.545 INFO:tasks.workunit.client.0.smithi005.stdout: 1 41113 0.74 MB/sec execute 169 sec latency 46.592 ms 2024-04-26T21:44:17.543 INFO:tasks.workunit.client.0.smithi005.stdout: 1 41245 0.74 MB/sec execute 170 sec latency 53.148 ms 2024-04-26T21:44:18.543 INFO:tasks.workunit.client.0.smithi005.stdout: 1 41420 0.74 MB/sec execute 171 sec latency 44.816 ms 2024-04-26T21:44:19.543 INFO:tasks.workunit.client.0.smithi005.stdout: 1 41512 0.74 MB/sec execute 172 sec latency 47.554 ms 2024-04-26T21:44:20.543 INFO:tasks.workunit.client.0.smithi005.stdout: 1 41657 0.74 MB/sec execute 173 sec latency 45.940 ms 2024-04-26T21:44:21.543 INFO:tasks.workunit.client.0.smithi005.stdout: 1 41951 0.75 MB/sec execute 174 sec latency 51.050 ms 2024-04-26T21:44:22.544 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42085 0.76 MB/sec execute 175 sec latency 54.301 ms 2024-04-26T21:44:23.544 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42344 0.76 MB/sec execute 176 sec latency 56.868 ms 2024-04-26T21:44:24.544 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42372 0.76 MB/sec execute 177 sec latency 77.161 ms 2024-04-26T21:44:25.544 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42425 0.75 MB/sec execute 178 sec latency 61.873 ms 2024-04-26T21:44:26.544 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42633 0.77 MB/sec execute 179 sec latency 50.297 ms 2024-04-26T21:44:27.545 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42809 0.77 MB/sec execute 180 sec latency 52.012 ms 2024-04-26T21:44:28.546 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42893 0.76 MB/sec execute 181 sec latency 28.754 ms 2024-04-26T21:44:29.547 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42981 0.76 MB/sec execute 182 sec latency 45.709 ms 2024-04-26T21:44:30.548 INFO:tasks.workunit.client.0.smithi005.stdout: 1 43064 0.76 MB/sec execute 183 sec latency 37.111 ms 2024-04-26T21:44:31.552 INFO:tasks.workunit.client.0.smithi005.stdout: 1 43156 0.75 MB/sec execute 184 sec latency 45.611 ms 2024-04-26T21:44:32.553 INFO:tasks.workunit.client.0.smithi005.stdout: 1 43286 0.75 MB/sec execute 185 sec latency 53.339 ms 2024-04-26T21:44:33.553 INFO:tasks.workunit.client.0.smithi005.stdout: 1 43431 0.75 MB/sec execute 186 sec latency 47.372 ms 2024-04-26T21:44:34.553 INFO:tasks.workunit.client.0.smithi005.stdout: 1 43571 0.75 MB/sec execute 187 sec latency 48.308 ms 2024-04-26T21:44:35.553 INFO:tasks.workunit.client.0.smithi005.stdout: 1 43723 0.75 MB/sec execute 188 sec latency 46.166 ms 2024-04-26T21:44:36.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 43850 0.74 MB/sec execute 189 sec latency 54.873 ms 2024-04-26T21:44:37.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 44049 0.76 MB/sec execute 190 sec latency 52.277 ms 2024-04-26T21:44:38.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 44175 0.75 MB/sec execute 191 sec latency 51.001 ms 2024-04-26T21:44:39.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 44307 0.75 MB/sec execute 192 sec latency 46.888 ms 2024-04-26T21:44:40.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 44467 0.75 MB/sec execute 193 sec latency 51.316 ms 2024-04-26T21:44:41.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 44621 0.74 MB/sec execute 194 sec latency 123.987 ms 2024-04-26T21:44:42.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 44768 0.74 MB/sec execute 195 sec latency 45.799 ms 2024-04-26T21:44:43.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 44926 0.74 MB/sec execute 196 sec latency 49.221 ms 2024-04-26T21:44:44.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45028 0.74 MB/sec execute 197 sec latency 49.186 ms 2024-04-26T21:44:45.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45168 0.74 MB/sec execute 198 sec latency 52.459 ms 2024-04-26T21:44:45.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:44:45.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:44:46.554 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45372 0.75 MB/sec execute 199 sec latency 49.141 ms 2024-04-26T21:44:47.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45591 0.76 MB/sec execute 200 sec latency 54.712 ms 2024-04-26T21:44:48.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45878 0.76 MB/sec execute 201 sec latency 48.026 ms 2024-04-26T21:44:49.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45910 0.76 MB/sec execute 202 sec latency 51.051 ms 2024-04-26T21:44:50.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45948 0.75 MB/sec execute 203 sec latency 52.469 ms 2024-04-26T21:44:51.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46157 0.77 MB/sec execute 204 sec latency 45.561 ms 2024-04-26T21:44:52.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46308 0.76 MB/sec execute 205 sec latency 45.787 ms 2024-04-26T21:44:53.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46424 0.76 MB/sec execute 206 sec latency 52.850 ms 2024-04-26T21:44:54.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46511 0.76 MB/sec execute 207 sec latency 47.529 ms 2024-04-26T21:44:55.555 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46594 0.76 MB/sec execute 208 sec latency 32.654 ms 2024-04-26T21:44:56.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46681 0.75 MB/sec execute 209 sec latency 45.887 ms 2024-04-26T21:44:57.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46807 0.75 MB/sec execute 210 sec latency 50.481 ms 2024-04-26T21:44:58.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 46967 0.75 MB/sec execute 211 sec latency 56.502 ms 2024-04-26T21:44:59.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47089 0.75 MB/sec execute 212 sec latency 55.237 ms 2024-04-26T21:45:00.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47244 0.75 MB/sec execute 213 sec latency 49.553 ms 2024-04-26T21:45:01.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47368 0.75 MB/sec execute 214 sec latency 47.313 ms 2024-04-26T21:45:02.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47569 0.76 MB/sec execute 215 sec latency 50.595 ms 2024-04-26T21:45:03.556 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47694 0.75 MB/sec execute 216 sec latency 46.317 ms 2024-04-26T21:45:04.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47839 0.75 MB/sec execute 217 sec latency 48.797 ms 2024-04-26T21:45:05.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47994 0.75 MB/sec execute 218 sec latency 46.162 ms 2024-04-26T21:45:06.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 48145 0.75 MB/sec execute 219 sec latency 49.408 ms 2024-04-26T21:45:07.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 48288 0.74 MB/sec execute 220 sec latency 62.742 ms 2024-04-26T21:45:08.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 48454 0.74 MB/sec execute 221 sec latency 53.228 ms 2024-04-26T21:45:09.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 48548 0.74 MB/sec execute 222 sec latency 54.046 ms 2024-04-26T21:45:10.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 48695 0.74 MB/sec execute 223 sec latency 48.157 ms 2024-04-26T21:45:11.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 48892 0.75 MB/sec execute 224 sec latency 51.826 ms 2024-04-26T21:45:12.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 49117 0.76 MB/sec execute 225 sec latency 51.213 ms 2024-04-26T21:45:13.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 49408 0.76 MB/sec execute 226 sec latency 48.908 ms 2024-04-26T21:45:14.557 INFO:tasks.workunit.client.0.smithi005.stdout: 1 49450 0.76 MB/sec execute 227 sec latency 56.284 ms 2024-04-26T21:45:15.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 49475 0.76 MB/sec execute 228 sec latency 58.769 ms 2024-04-26T21:45:15.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:45:15.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:45:16.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 49686 0.77 MB/sec execute 229 sec latency 49.179 ms 2024-04-26T21:45:17.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 49821 0.76 MB/sec execute 230 sec latency 46.841 ms 2024-04-26T21:45:18.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 49949 0.76 MB/sec execute 231 sec latency 46.140 ms 2024-04-26T21:45:19.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50032 0.76 MB/sec execute 232 sec latency 44.938 ms 2024-04-26T21:45:20.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50118 0.76 MB/sec execute 233 sec latency 43.893 ms 2024-04-26T21:45:21.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50197 0.76 MB/sec execute 234 sec latency 45.663 ms 2024-04-26T21:45:22.558 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50310 0.75 MB/sec execute 235 sec latency 48.835 ms 2024-04-26T21:45:23.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50469 0.75 MB/sec execute 236 sec latency 58.947 ms 2024-04-26T21:45:24.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50603 0.75 MB/sec execute 237 sec latency 50.158 ms 2024-04-26T21:45:25.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50745 0.75 MB/sec execute 238 sec latency 61.870 ms 2024-04-26T21:45:26.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50869 0.75 MB/sec execute 239 sec latency 47.750 ms 2024-04-26T21:45:27.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 51076 0.76 MB/sec execute 240 sec latency 52.435 ms 2024-04-26T21:45:28.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 51196 0.75 MB/sec execute 241 sec latency 53.580 ms 2024-04-26T21:45:29.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 51321 0.75 MB/sec execute 242 sec latency 52.546 ms 2024-04-26T21:45:30.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 51501 0.75 MB/sec execute 243 sec latency 50.938 ms 2024-04-26T21:45:31.559 INFO:tasks.workunit.client.0.smithi005.stdout: 1 51617 0.75 MB/sec execute 244 sec latency 46.376 ms 2024-04-26T21:45:32.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 51775 0.74 MB/sec execute 245 sec latency 51.644 ms 2024-04-26T21:45:33.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 51944 0.74 MB/sec execute 246 sec latency 53.351 ms 2024-04-26T21:45:34.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 52063 0.74 MB/sec execute 247 sec latency 53.331 ms 2024-04-26T21:45:35.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 52184 0.74 MB/sec execute 248 sec latency 46.197 ms 2024-04-26T21:45:36.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 52308 0.74 MB/sec execute 249 sec latency 53.576 ms 2024-04-26T21:45:37.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 52613 0.76 MB/sec execute 250 sec latency 56.452 ms 2024-04-26T21:45:38.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 52875 0.76 MB/sec execute 251 sec latency 54.623 ms 2024-04-26T21:45:39.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 52982 0.76 MB/sec execute 252 sec latency 46.117 ms 2024-04-26T21:45:40.560 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53013 0.76 MB/sec execute 253 sec latency 50.726 ms 2024-04-26T21:45:41.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53081 0.75 MB/sec execute 254 sec latency 52.087 ms 2024-04-26T21:45:42.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53321 0.76 MB/sec execute 255 sec latency 45.551 ms 2024-04-26T21:45:43.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53468 0.76 MB/sec execute 256 sec latency 45.326 ms 2024-04-26T21:45:44.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53548 0.76 MB/sec execute 257 sec latency 35.120 ms 2024-04-26T21:45:45.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53637 0.76 MB/sec execute 258 sec latency 52.986 ms 2024-04-26T21:45:46.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:45:46.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:45:46.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53720 0.76 MB/sec execute 259 sec latency 44.519 ms 2024-04-26T21:45:47.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53839 0.75 MB/sec execute 260 sec latency 52.217 ms 2024-04-26T21:45:48.561 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53960 0.75 MB/sec execute 261 sec latency 60.517 ms 2024-04-26T21:45:49.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 54110 0.75 MB/sec execute 262 sec latency 53.606 ms 2024-04-26T21:45:50.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 54253 0.75 MB/sec execute 263 sec latency 46.274 ms 2024-04-26T21:45:51.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 54401 0.75 MB/sec execute 264 sec latency 46.508 ms 2024-04-26T21:45:52.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 54524 0.75 MB/sec execute 265 sec latency 50.282 ms 2024-04-26T21:45:53.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 54728 0.76 MB/sec execute 266 sec latency 52.362 ms 2024-04-26T21:45:54.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 54852 0.75 MB/sec execute 267 sec latency 47.779 ms 2024-04-26T21:45:55.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 55023 0.75 MB/sec execute 268 sec latency 49.116 ms 2024-04-26T21:45:56.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 55152 0.75 MB/sec execute 269 sec latency 46.605 ms 2024-04-26T21:45:57.562 INFO:tasks.workunit.client.0.smithi005.stdout: 1 55306 0.75 MB/sec execute 270 sec latency 49.979 ms 2024-04-26T21:45:58.563 INFO:tasks.workunit.client.0.smithi005.stdout: 1 55459 0.74 MB/sec execute 271 sec latency 50.096 ms 2024-04-26T21:45:59.563 INFO:tasks.workunit.client.0.smithi005.stdout: 1 55605 0.75 MB/sec execute 272 sec latency 49.158 ms 2024-04-26T21:46:00.563 INFO:tasks.workunit.client.0.smithi005.stdout: 1 55727 0.75 MB/sec execute 273 sec latency 52.340 ms 2024-04-26T21:46:01.563 INFO:tasks.workunit.client.0.smithi005.stdout: 1 55852 0.74 MB/sec execute 274 sec latency 52.078 ms 2024-04-26T21:46:02.563 INFO:tasks.workunit.client.0.smithi005.stdout: 1 56152 0.76 MB/sec execute 275 sec latency 53.223 ms 2024-04-26T21:46:03.563 INFO:tasks.workunit.client.0.smithi005.stdout: 1 56410 0.76 MB/sec execute 276 sec latency 51.756 ms 2024-04-26T21:46:04.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 56528 0.76 MB/sec execute 277 sec latency 68.117 ms 2024-04-26T21:46:05.563 INFO:tasks.workunit.client.0.smithi005.stdout: 1 56559 0.76 MB/sec execute 278 sec latency 48.788 ms 2024-04-26T21:46:06.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 56629 0.75 MB/sec execute 279 sec latency 59.664 ms 2024-04-26T21:46:07.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 56868 0.76 MB/sec execute 280 sec latency 58.442 ms 2024-04-26T21:46:08.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57009 0.76 MB/sec execute 281 sec latency 51.779 ms 2024-04-26T21:46:09.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57092 0.76 MB/sec execute 282 sec latency 40.395 ms 2024-04-26T21:46:10.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57179 0.76 MB/sec execute 283 sec latency 44.817 ms 2024-04-26T21:46:11.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57259 0.76 MB/sec execute 284 sec latency 47.228 ms 2024-04-26T21:46:12.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57368 0.75 MB/sec execute 285 sec latency 56.705 ms 2024-04-26T21:46:13.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57491 0.75 MB/sec execute 286 sec latency 65.288 ms 2024-04-26T21:46:14.564 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57645 0.75 MB/sec execute 287 sec latency 52.582 ms 2024-04-26T21:46:15.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57762 0.75 MB/sec execute 288 sec latency 45.806 ms 2024-04-26T21:46:16.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:46:16.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:46:16.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 57895 0.75 MB/sec execute 289 sec latency 204.363 ms 2024-04-26T21:46:17.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 58029 0.75 MB/sec execute 290 sec latency 49.115 ms 2024-04-26T21:46:18.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 58228 0.76 MB/sec execute 291 sec latency 50.251 ms 2024-04-26T21:46:19.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 58360 0.75 MB/sec execute 292 sec latency 50.550 ms 2024-04-26T21:46:20.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 58493 0.75 MB/sec execute 293 sec latency 52.949 ms 2024-04-26T21:46:21.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 58648 0.75 MB/sec execute 294 sec latency 51.189 ms 2024-04-26T21:46:22.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 58818 0.75 MB/sec execute 295 sec latency 54.449 ms 2024-04-26T21:46:23.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 58958 0.75 MB/sec execute 296 sec latency 46.126 ms 2024-04-26T21:46:24.565 INFO:tasks.workunit.client.0.smithi005.stdout: 1 59121 0.75 MB/sec execute 297 sec latency 44.987 ms 2024-04-26T21:46:25.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 59216 0.75 MB/sec execute 298 sec latency 54.954 ms 2024-04-26T21:46:26.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 59360 0.75 MB/sec execute 299 sec latency 47.305 ms 2024-04-26T21:46:27.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 59572 0.75 MB/sec execute 300 sec latency 50.243 ms 2024-04-26T21:46:28.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 59788 0.76 MB/sec execute 301 sec latency 45.541 ms 2024-04-26T21:46:29.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60062 0.76 MB/sec execute 302 sec latency 46.247 ms 2024-04-26T21:46:30.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60093 0.76 MB/sec execute 303 sec latency 67.573 ms 2024-04-26T21:46:31.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60142 0.76 MB/sec execute 304 sec latency 54.883 ms 2024-04-26T21:46:32.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60357 0.76 MB/sec execute 305 sec latency 50.192 ms 2024-04-26T21:46:33.566 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60529 0.76 MB/sec execute 306 sec latency 64.628 ms 2024-04-26T21:46:34.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60612 0.76 MB/sec execute 307 sec latency 35.323 ms 2024-04-26T21:46:35.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60704 0.76 MB/sec execute 308 sec latency 52.794 ms 2024-04-26T21:46:36.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60783 0.76 MB/sec execute 309 sec latency 63.083 ms 2024-04-26T21:46:37.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60873 0.76 MB/sec execute 310 sec latency 56.044 ms 2024-04-26T21:46:38.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 60994 0.75 MB/sec execute 311 sec latency 55.255 ms 2024-04-26T21:46:39.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 61153 0.75 MB/sec execute 312 sec latency 46.327 ms 2024-04-26T21:46:40.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 61275 0.75 MB/sec execute 313 sec latency 47.624 ms 2024-04-26T21:46:41.567 INFO:tasks.workunit.client.0.smithi005.stdout: 1 61425 0.75 MB/sec execute 314 sec latency 54.845 ms 2024-04-26T21:46:42.568 INFO:tasks.workunit.client.0.smithi005.stdout: 1 61550 0.75 MB/sec execute 315 sec latency 50.296 ms 2024-04-26T21:46:43.568 INFO:tasks.workunit.client.0.smithi005.stdout: 1 61753 0.76 MB/sec execute 316 sec latency 48.481 ms 2024-04-26T21:46:44.568 INFO:tasks.workunit.client.0.smithi005.stdout: 1 61889 0.76 MB/sec execute 317 sec latency 45.044 ms 2024-04-26T21:46:45.568 INFO:tasks.workunit.client.0.smithi005.stdout: 1 62024 0.75 MB/sec execute 318 sec latency 51.327 ms 2024-04-26T21:46:46.568 INFO:tasks.workunit.client.0.smithi005.stdout: 1 62184 0.75 MB/sec execute 319 sec latency 46.034 ms 2024-04-26T21:46:46.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:46:46.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:46:47.568 INFO:tasks.workunit.client.0.smithi005.stdout: 1 62348 0.75 MB/sec execute 320 sec latency 53.926 ms 2024-04-26T21:46:48.568 INFO:tasks.workunit.client.0.smithi005.stdout: 1 62499 0.75 MB/sec execute 321 sec latency 45.893 ms 2024-04-26T21:46:49.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 62664 0.75 MB/sec execute 322 sec latency 48.801 ms 2024-04-26T21:46:50.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 62760 0.75 MB/sec execute 323 sec latency 52.916 ms 2024-04-26T21:46:51.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 62900 0.75 MB/sec execute 324 sec latency 52.038 ms 2024-04-26T21:46:52.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 63100 0.75 MB/sec execute 325 sec latency 54.907 ms 2024-04-26T21:46:53.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 63320 0.76 MB/sec execute 326 sec latency 49.124 ms 2024-04-26T21:46:54.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 63606 0.76 MB/sec execute 327 sec latency 52.507 ms 2024-04-26T21:46:55.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 63637 0.76 MB/sec execute 328 sec latency 70.643 ms 2024-04-26T21:46:56.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 63666 0.76 MB/sec execute 329 sec latency 49.257 ms 2024-04-26T21:46:57.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 63881 0.76 MB/sec execute 330 sec latency 45.729 ms 2024-04-26T21:46:58.569 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64025 0.76 MB/sec execute 331 sec latency 50.178 ms 2024-04-26T21:46:59.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64142 0.76 MB/sec execute 332 sec latency 52.825 ms 2024-04-26T21:47:00.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64229 0.76 MB/sec execute 333 sec latency 53.714 ms 2024-04-26T21:47:01.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64311 0.76 MB/sec execute 334 sec latency 33.869 ms 2024-04-26T21:47:02.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64390 0.76 MB/sec execute 335 sec latency 46.252 ms 2024-04-26T21:47:03.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64522 0.75 MB/sec execute 336 sec latency 58.822 ms 2024-04-26T21:47:04.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64661 0.75 MB/sec execute 337 sec latency 51.231 ms 2024-04-26T21:47:05.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64811 0.75 MB/sec execute 338 sec latency 50.952 ms 2024-04-26T21:47:06.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64959 0.75 MB/sec execute 339 sec latency 46.234 ms 2024-04-26T21:47:07.570 INFO:tasks.workunit.client.0.smithi005.stdout: 1 65078 0.75 MB/sec execute 340 sec latency 51.146 ms 2024-04-26T21:47:08.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 65273 0.76 MB/sec execute 341 sec latency 47.250 ms 2024-04-26T21:47:09.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 65407 0.76 MB/sec execute 342 sec latency 45.381 ms 2024-04-26T21:47:10.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 65539 0.75 MB/sec execute 343 sec latency 50.589 ms 2024-04-26T21:47:11.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 65716 0.75 MB/sec execute 344 sec latency 44.379 ms 2024-04-26T21:47:12.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 65871 0.75 MB/sec execute 345 sec latency 48.072 ms 2024-04-26T21:47:13.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 66013 0.75 MB/sec execute 346 sec latency 50.885 ms 2024-04-26T21:47:14.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 66179 0.75 MB/sec execute 347 sec latency 50.850 ms 2024-04-26T21:47:15.571 INFO:tasks.workunit.client.0.smithi005.stdout: 1 66282 0.75 MB/sec execute 348 sec latency 45.923 ms 2024-04-26T21:47:16.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 66430 0.75 MB/sec execute 349 sec latency 44.880 ms 2024-04-26T21:47:16.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:47:16.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:47:17.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 66633 0.76 MB/sec execute 350 sec latency 51.712 ms 2024-04-26T21:47:18.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 66857 0.76 MB/sec execute 351 sec latency 46.689 ms 2024-04-26T21:47:19.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67148 0.76 MB/sec execute 352 sec latency 55.501 ms 2024-04-26T21:47:20.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67178 0.76 MB/sec execute 353 sec latency 64.970 ms 2024-04-26T21:47:21.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67204 0.76 MB/sec execute 354 sec latency 55.006 ms 2024-04-26T21:47:22.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67417 0.76 MB/sec execute 355 sec latency 45.545 ms 2024-04-26T21:47:23.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67558 0.76 MB/sec execute 356 sec latency 45.502 ms 2024-04-26T21:47:24.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67680 0.76 MB/sec execute 357 sec latency 44.542 ms 2024-04-26T21:47:25.572 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67768 0.76 MB/sec execute 358 sec latency 46.390 ms 2024-04-26T21:47:26.573 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67853 0.76 MB/sec execute 359 sec latency 44.175 ms 2024-04-26T21:47:27.573 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67932 0.76 MB/sec execute 360 sec latency 45.578 ms 2024-04-26T21:47:28.573 INFO:tasks.workunit.client.0.smithi005.stdout: 1 68047 0.75 MB/sec execute 361 sec latency 51.596 ms 2024-04-26T21:47:29.573 INFO:tasks.workunit.client.0.smithi005.stdout: 1 68210 0.75 MB/sec execute 362 sec latency 46.829 ms 2024-04-26T21:47:30.573 INFO:tasks.workunit.client.0.smithi005.stdout: 1 68359 0.75 MB/sec execute 363 sec latency 46.773 ms 2024-04-26T21:47:31.573 INFO:tasks.workunit.client.0.smithi005.stdout: 1 68489 0.75 MB/sec execute 364 sec latency 48.346 ms 2024-04-26T21:47:32.573 INFO:tasks.workunit.client.0.smithi005.stdout: 1 68617 0.75 MB/sec execute 365 sec latency 46.046 ms 2024-04-26T21:47:33.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 68812 0.76 MB/sec execute 366 sec latency 55.734 ms 2024-04-26T21:47:34.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 68943 0.76 MB/sec execute 367 sec latency 45.590 ms 2024-04-26T21:47:35.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 69069 0.75 MB/sec execute 368 sec latency 52.712 ms 2024-04-26T21:47:36.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 69248 0.75 MB/sec execute 369 sec latency 49.625 ms 2024-04-26T21:47:37.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 69382 0.75 MB/sec execute 370 sec latency 54.263 ms 2024-04-26T21:47:38.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 69516 0.75 MB/sec execute 371 sec latency 48.050 ms 2024-04-26T21:47:39.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 69714 0.75 MB/sec execute 372 sec latency 52.024 ms 2024-04-26T21:47:40.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 69809 0.75 MB/sec execute 373 sec latency 52.165 ms 2024-04-26T21:47:41.574 INFO:tasks.workunit.client.0.smithi005.stdout: 1 69918 0.75 MB/sec execute 374 sec latency 51.218 ms 2024-04-26T21:47:42.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 70040 0.75 MB/sec execute 375 sec latency 51.351 ms 2024-04-26T21:47:43.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 70355 0.76 MB/sec execute 376 sec latency 47.519 ms 2024-04-26T21:47:44.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 70621 0.76 MB/sec execute 377 sec latency 46.991 ms 2024-04-26T21:47:45.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 70715 0.76 MB/sec execute 378 sec latency 58.223 ms 2024-04-26T21:47:46.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 70745 0.76 MB/sec execute 379 sec latency 49.489 ms 2024-04-26T21:47:46.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:47:46.899 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:47:47.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 70923 0.76 MB/sec execute 380 sec latency 53.564 ms 2024-04-26T21:47:48.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71073 0.76 MB/sec execute 381 sec latency 51.525 ms 2024-04-26T21:47:49.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71202 0.76 MB/sec execute 382 sec latency 45.745 ms 2024-04-26T21:47:50.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71283 0.76 MB/sec execute 383 sec latency 46.331 ms 2024-04-26T21:47:51.575 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71375 0.76 MB/sec execute 384 sec latency 43.753 ms 2024-04-26T21:47:52.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71452 0.76 MB/sec execute 385 sec latency 44.943 ms 2024-04-26T21:47:53.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71574 0.76 MB/sec execute 386 sec latency 44.249 ms 2024-04-26T21:47:54.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71712 0.75 MB/sec execute 387 sec latency 50.133 ms 2024-04-26T21:47:55.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71870 0.75 MB/sec execute 388 sec latency 55.362 ms 2024-04-26T21:47:56.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 72005 0.75 MB/sec execute 389 sec latency 51.856 ms 2024-04-26T21:47:57.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 72137 0.75 MB/sec execute 390 sec latency 50.112 ms 2024-04-26T21:47:58.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 72254 0.75 MB/sec execute 391 sec latency 54.426 ms 2024-04-26T21:47:59.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 72455 0.76 MB/sec execute 392 sec latency 46.642 ms 2024-04-26T21:48:00.576 INFO:tasks.workunit.client.0.smithi005.stdout: 1 72581 0.76 MB/sec execute 393 sec latency 53.416 ms 2024-04-26T21:48:01.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 72753 0.75 MB/sec execute 394 sec latency 51.446 ms 2024-04-26T21:48:02.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 72873 0.75 MB/sec execute 395 sec latency 54.010 ms 2024-04-26T21:48:03.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 73064 0.75 MB/sec execute 396 sec latency 48.553 ms 2024-04-26T21:48:04.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 73198 0.75 MB/sec execute 397 sec latency 49.602 ms 2024-04-26T21:48:05.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 73360 0.75 MB/sec execute 398 sec latency 53.064 ms 2024-04-26T21:48:06.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 73468 0.75 MB/sec execute 399 sec latency 46.242 ms 2024-04-26T21:48:07.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 73604 0.75 MB/sec execute 400 sec latency 45.817 ms 2024-04-26T21:48:08.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 73894 0.76 MB/sec execute 401 sec latency 54.832 ms 2024-04-26T21:48:09.577 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74160 0.76 MB/sec execute 402 sec latency 47.863 ms 2024-04-26T21:48:10.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74285 0.76 MB/sec execute 403 sec latency 56.232 ms 2024-04-26T21:48:11.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74316 0.76 MB/sec execute 404 sec latency 52.631 ms 2024-04-26T21:48:12.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74384 0.76 MB/sec execute 405 sec latency 51.403 ms 2024-04-26T21:48:13.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74622 0.76 MB/sec execute 406 sec latency 44.662 ms 2024-04-26T21:48:14.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74765 0.76 MB/sec execute 407 sec latency 49.766 ms 2024-04-26T21:48:15.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74845 0.76 MB/sec execute 408 sec latency 30.140 ms 2024-04-26T21:48:16.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 74928 0.76 MB/sec execute 409 sec latency 53.084 ms 2024-04-26T21:48:17.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:48:17.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:48:17.578 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75019 0.76 MB/sec execute 410 sec latency 47.953 ms 2024-04-26T21:48:18.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75132 0.76 MB/sec execute 411 sec latency 51.206 ms 2024-04-26T21:48:19.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75256 0.75 MB/sec execute 412 sec latency 57.128 ms 2024-04-26T21:48:20.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75418 0.75 MB/sec execute 413 sec latency 45.843 ms 2024-04-26T21:48:21.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75562 0.75 MB/sec execute 414 sec latency 49.626 ms 2024-04-26T21:48:22.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75705 0.75 MB/sec execute 415 sec latency 46.022 ms 2024-04-26T21:48:23.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75830 0.75 MB/sec execute 416 sec latency 50.486 ms 2024-04-26T21:48:24.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 76018 0.76 MB/sec execute 417 sec latency 46.667 ms 2024-04-26T21:48:25.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 76155 0.76 MB/sec execute 418 sec latency 53.868 ms 2024-04-26T21:48:26.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 76319 0.75 MB/sec execute 419 sec latency 51.448 ms 2024-04-26T21:48:27.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 76447 0.75 MB/sec execute 420 sec latency 55.150 ms 2024-04-26T21:48:28.579 INFO:tasks.workunit.client.0.smithi005.stdout: 1 76603 0.75 MB/sec execute 421 sec latency 47.560 ms 2024-04-26T21:48:29.580 INFO:tasks.workunit.client.0.smithi005.stdout: 1 76744 0.75 MB/sec execute 422 sec latency 48.869 ms 2024-04-26T21:48:30.580 INFO:tasks.workunit.client.0.smithi005.stdout: 1 76907 0.75 MB/sec execute 423 sec latency 48.349 ms 2024-04-26T21:48:31.580 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77012 0.75 MB/sec execute 424 sec latency 49.622 ms 2024-04-26T21:48:32.580 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77146 0.75 MB/sec execute 425 sec latency 50.342 ms 2024-04-26T21:48:33.580 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77443 0.76 MB/sec execute 426 sec latency 47.877 ms 2024-04-26T21:48:34.580 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77709 0.76 MB/sec execute 427 sec latency 53.161 ms 2024-04-26T21:48:35.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77832 0.76 MB/sec execute 428 sec latency 62.912 ms 2024-04-26T21:48:36.580 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77863 0.76 MB/sec execute 429 sec latency 55.992 ms 2024-04-26T21:48:37.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77921 0.76 MB/sec execute 430 sec latency 53.138 ms 2024-04-26T21:48:38.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78160 0.76 MB/sec execute 431 sec latency 46.220 ms 2024-04-26T21:48:39.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78306 0.76 MB/sec execute 432 sec latency 46.824 ms 2024-04-26T21:48:40.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78389 0.76 MB/sec execute 433 sec latency 30.205 ms 2024-04-26T21:48:41.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78477 0.76 MB/sec execute 434 sec latency 46.694 ms 2024-04-26T21:48:42.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78545 0.76 MB/sec execute 435 sec latency 221.597 ms 2024-04-26T21:48:43.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78641 0.76 MB/sec execute 436 sec latency 45.895 ms 2024-04-26T21:48:44.581 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78754 0.76 MB/sec execute 437 sec latency 69.673 ms 2024-04-26T21:48:45.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 78915 0.75 MB/sec execute 438 sec latency 46.755 ms 2024-04-26T21:48:46.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79055 0.75 MB/sec execute 439 sec latency 51.411 ms 2024-04-26T21:48:47.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:48:47.157 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:48:47.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79208 0.75 MB/sec execute 440 sec latency 53.728 ms 2024-04-26T21:48:48.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79341 0.75 MB/sec execute 441 sec latency 49.348 ms 2024-04-26T21:48:49.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79539 0.76 MB/sec execute 442 sec latency 48.648 ms 2024-04-26T21:48:50.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79668 0.76 MB/sec execute 443 sec latency 48.531 ms 2024-04-26T21:48:51.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79799 0.75 MB/sec execute 444 sec latency 55.651 ms 2024-04-26T21:48:52.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79955 0.75 MB/sec execute 445 sec latency 45.635 ms 2024-04-26T21:48:53.582 INFO:tasks.workunit.client.0.smithi005.stdout: 1 80124 0.75 MB/sec execute 446 sec latency 51.577 ms 2024-04-26T21:48:54.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 80263 0.75 MB/sec execute 447 sec latency 56.869 ms 2024-04-26T21:48:55.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 80423 0.75 MB/sec execute 448 sec latency 50.102 ms 2024-04-26T21:48:56.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 80520 0.75 MB/sec execute 449 sec latency 45.663 ms 2024-04-26T21:48:57.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 80666 0.75 MB/sec execute 450 sec latency 49.323 ms 2024-04-26T21:48:58.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 80865 0.76 MB/sec execute 451 sec latency 52.566 ms 2024-04-26T21:48:59.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 81093 0.76 MB/sec execute 452 sec latency 50.964 ms 2024-04-26T21:49:00.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 81368 0.76 MB/sec execute 453 sec latency 51.525 ms 2024-04-26T21:49:01.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 81399 0.76 MB/sec execute 454 sec latency 52.919 ms 2024-04-26T21:49:02.583 INFO:tasks.workunit.client.0.smithi005.stdout: 1 81444 0.76 MB/sec execute 455 sec latency 47.674 ms 2024-04-26T21:49:03.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 81652 0.76 MB/sec execute 456 sec latency 46.510 ms 2024-04-26T21:49:04.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 81832 0.76 MB/sec execute 457 sec latency 47.811 ms 2024-04-26T21:49:05.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 81918 0.76 MB/sec execute 458 sec latency 46.547 ms 2024-04-26T21:49:06.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82006 0.76 MB/sec execute 459 sec latency 45.402 ms 2024-04-26T21:49:07.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82089 0.76 MB/sec execute 460 sec latency 37.364 ms 2024-04-26T21:49:08.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82181 0.76 MB/sec execute 461 sec latency 62.370 ms 2024-04-26T21:49:09.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82301 0.76 MB/sec execute 462 sec latency 56.762 ms 2024-04-26T21:49:10.584 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82460 0.75 MB/sec execute 463 sec latency 45.644 ms 2024-04-26T21:49:11.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82587 0.75 MB/sec execute 464 sec latency 70.379 ms 2024-04-26T21:49:12.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82743 0.75 MB/sec execute 465 sec latency 49.884 ms 2024-04-26T21:49:13.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82867 0.75 MB/sec execute 466 sec latency 52.131 ms 2024-04-26T21:49:14.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 83059 0.76 MB/sec execute 467 sec latency 50.752 ms 2024-04-26T21:49:15.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 83196 0.76 MB/sec execute 468 sec latency 50.465 ms 2024-04-26T21:49:16.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 83334 0.76 MB/sec execute 469 sec latency 44.953 ms 2024-04-26T21:49:17.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:49:17.293 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:49:17.585 INFO:tasks.workunit.client.0.smithi005.stdout: 1 83499 0.75 MB/sec execute 470 sec latency 48.956 ms 2024-04-26T21:49:18.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 83658 0.75 MB/sec execute 471 sec latency 51.907 ms 2024-04-26T21:49:19.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 83805 0.75 MB/sec execute 472 sec latency 48.118 ms 2024-04-26T21:49:20.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 83968 0.75 MB/sec execute 473 sec latency 51.846 ms 2024-04-26T21:49:21.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 84068 0.75 MB/sec execute 474 sec latency 48.514 ms 2024-04-26T21:49:22.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 84211 0.75 MB/sec execute 475 sec latency 50.953 ms 2024-04-26T21:49:23.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 84412 0.76 MB/sec execute 476 sec latency 53.489 ms 2024-04-26T21:49:24.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 84629 0.76 MB/sec execute 477 sec latency 53.417 ms 2024-04-26T21:49:25.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 84915 0.76 MB/sec execute 478 sec latency 47.779 ms 2024-04-26T21:49:26.586 INFO:tasks.workunit.client.0.smithi005.stdout: 1 84948 0.76 MB/sec execute 479 sec latency 53.575 ms 2024-04-26T21:49:27.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 84992 0.76 MB/sec execute 480 sec latency 50.117 ms 2024-04-26T21:49:28.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85203 0.76 MB/sec execute 481 sec latency 46.981 ms 2024-04-26T21:49:29.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85379 0.76 MB/sec execute 482 sec latency 47.535 ms 2024-04-26T21:49:30.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85459 0.76 MB/sec execute 483 sec latency 45.324 ms 2024-04-26T21:49:31.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85552 0.76 MB/sec execute 484 sec latency 48.493 ms 2024-04-26T21:49:32.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85635 0.76 MB/sec execute 485 sec latency 28.512 ms 2024-04-26T21:49:33.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85724 0.76 MB/sec execute 486 sec latency 50.591 ms 2024-04-26T21:49:34.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85843 0.76 MB/sec execute 487 sec latency 65.402 ms 2024-04-26T21:49:35.587 INFO:tasks.workunit.client.0.smithi005.stdout: 1 86003 0.76 MB/sec execute 488 sec latency 45.906 ms 2024-04-26T21:49:36.588 INFO:tasks.workunit.client.0.smithi005.stdout: 1 86141 0.75 MB/sec execute 489 sec latency 50.977 ms 2024-04-26T21:49:37.588 INFO:tasks.workunit.client.0.smithi005.stdout: 1 86285 0.76 MB/sec execute 490 sec latency 46.921 ms 2024-04-26T21:49:38.588 INFO:tasks.workunit.client.0.smithi005.stdout: 1 86416 0.75 MB/sec execute 491 sec latency 52.396 ms 2024-04-26T21:49:39.588 INFO:tasks.workunit.client.0.smithi005.stdout: 1 86602 0.76 MB/sec execute 492 sec latency 53.818 ms 2024-04-26T21:49:40.588 INFO:tasks.workunit.client.0.smithi005.stdout: 1 86738 0.76 MB/sec execute 493 sec latency 47.509 ms 2024-04-26T21:49:41.588 INFO:tasks.workunit.client.0.smithi005.stdout: 1 86883 0.76 MB/sec execute 494 sec latency 54.170 ms 2024-04-26T21:49:42.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 87041 0.75 MB/sec execute 495 sec latency 45.285 ms 2024-04-26T21:49:43.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 87211 0.75 MB/sec execute 496 sec latency 46.990 ms 2024-04-26T21:49:44.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 87352 0.75 MB/sec execute 497 sec latency 48.808 ms 2024-04-26T21:49:45.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 87512 0.75 MB/sec execute 498 sec latency 47.032 ms 2024-04-26T21:49:46.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 87610 0.75 MB/sec execute 499 sec latency 45.884 ms 2024-04-26T21:49:47.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:49:47.416 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:49:47.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 87759 0.75 MB/sec execute 500 sec latency 52.829 ms 2024-04-26T21:49:48.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 88048 0.76 MB/sec execute 501 sec latency 48.930 ms 2024-04-26T21:49:49.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 88192 0.76 MB/sec execute 502 sec latency 53.295 ms 2024-04-26T21:49:50.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 88460 0.76 MB/sec execute 503 sec latency 53.581 ms 2024-04-26T21:49:51.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 88492 0.76 MB/sec execute 504 sec latency 47.896 ms 2024-04-26T21:49:52.589 INFO:tasks.workunit.client.0.smithi005.stdout: 1 88540 0.76 MB/sec execute 505 sec latency 51.219 ms 2024-04-26T21:49:53.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 88751 0.76 MB/sec execute 506 sec latency 53.736 ms 2024-04-26T21:49:54.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 88925 0.76 MB/sec execute 507 sec latency 48.449 ms 2024-04-26T21:49:55.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89013 0.76 MB/sec execute 508 sec latency 27.994 ms 2024-04-26T21:49:56.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89104 0.76 MB/sec execute 509 sec latency 51.839 ms 2024-04-26T21:49:57.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89188 0.76 MB/sec execute 510 sec latency 32.690 ms 2024-04-26T21:49:58.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89282 0.76 MB/sec execute 511 sec latency 49.858 ms 2024-04-26T21:49:59.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89393 0.76 MB/sec execute 512 sec latency 59.013 ms 2024-04-26T21:50:00.590 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89554 0.76 MB/sec execute 513 sec latency 52.964 ms 2024-04-26T21:50:01.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89697 0.75 MB/sec execute 514 sec latency 49.400 ms 2024-04-26T21:50:02.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89835 0.76 MB/sec execute 515 sec latency 55.891 ms 2024-04-26T21:50:03.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89965 0.75 MB/sec execute 516 sec latency 46.927 ms 2024-04-26T21:50:04.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 90156 0.76 MB/sec execute 517 sec latency 50.145 ms 2024-04-26T21:50:05.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 90294 0.76 MB/sec execute 518 sec latency 46.819 ms 2024-04-26T21:50:06.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 90433 0.76 MB/sec execute 519 sec latency 44.865 ms 2024-04-26T21:50:07.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 90594 0.76 MB/sec execute 520 sec latency 49.569 ms 2024-04-26T21:50:08.591 INFO:tasks.workunit.client.0.smithi005.stdout: 1 90763 0.75 MB/sec execute 521 sec latency 49.956 ms 2024-04-26T21:50:09.592 INFO:tasks.workunit.client.0.smithi005.stdout: 1 90902 0.75 MB/sec execute 522 sec latency 52.380 ms 2024-04-26T21:50:10.593 INFO:tasks.workunit.client.0.smithi005.stdout: 1 91062 0.75 MB/sec execute 523 sec latency 53.765 ms 2024-04-26T21:50:11.592 INFO:tasks.workunit.client.0.smithi005.stdout: 1 91159 0.75 MB/sec execute 524 sec latency 53.556 ms 2024-04-26T21:50:12.592 INFO:tasks.workunit.client.0.smithi005.stdout: 1 91306 0.75 MB/sec execute 525 sec latency 49.463 ms 2024-04-26T21:50:13.592 INFO:tasks.workunit.client.0.smithi005.stdout: 1 91504 0.76 MB/sec execute 526 sec latency 52.120 ms 2024-04-26T21:50:14.593 INFO:tasks.workunit.client.0.smithi005.stdout: 1 91719 0.76 MB/sec execute 527 sec latency 50.464 ms 2024-04-26T21:50:15.592 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92004 0.76 MB/sec execute 528 sec latency 50.029 ms 2024-04-26T21:50:16.592 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92036 0.76 MB/sec execute 529 sec latency 47.911 ms 2024-04-26T21:50:17.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:50:17.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:50:17.592 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92073 0.76 MB/sec execute 530 sec latency 53.480 ms 2024-04-26T21:50:18.593 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92115 0.76 MB/sec execute 531 sec latency 406.327 ms 2024-04-26T21:50:19.593 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92347 0.76 MB/sec execute 532 sec latency 50.426 ms 2024-04-26T21:50:20.593 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92491 0.76 MB/sec execute 533 sec latency 52.527 ms 2024-04-26T21:50:21.593 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92575 0.76 MB/sec execute 534 sec latency 28.227 ms 2024-04-26T21:50:22.593 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92663 0.76 MB/sec execute 535 sec latency 53.371 ms 2024-04-26T21:50:23.594 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92743 0.76 MB/sec execute 536 sec latency 52.248 ms 2024-04-26T21:50:24.594 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92851 0.76 MB/sec execute 537 sec latency 53.740 ms 2024-04-26T21:50:25.594 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92967 0.76 MB/sec execute 538 sec latency 51.577 ms 2024-04-26T21:50:26.595 INFO:tasks.workunit.client.0.smithi005.stdout: 1 93134 0.76 MB/sec execute 539 sec latency 50.648 ms 2024-04-26T21:50:27.595 INFO:tasks.workunit.client.0.smithi005.stdout: 1 93272 0.75 MB/sec execute 540 sec latency 46.844 ms 2024-04-26T21:50:28.595 INFO:tasks.workunit.client.0.smithi005.stdout: 1 93413 0.75 MB/sec execute 541 sec latency 51.500 ms 2024-04-26T21:50:29.595 INFO:tasks.workunit.client.0.smithi005.stdout: 1 93549 0.75 MB/sec execute 542 sec latency 49.717 ms 2024-04-26T21:50:30.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 93739 0.76 MB/sec execute 543 sec latency 50.364 ms 2024-04-26T21:50:31.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 93872 0.76 MB/sec execute 544 sec latency 52.584 ms 2024-04-26T21:50:32.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 94033 0.76 MB/sec execute 545 sec latency 50.924 ms 2024-04-26T21:50:33.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 94159 0.75 MB/sec execute 546 sec latency 50.496 ms 2024-04-26T21:50:34.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 94326 0.75 MB/sec execute 547 sec latency 45.173 ms 2024-04-26T21:50:35.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 94455 0.75 MB/sec execute 548 sec latency 54.465 ms 2024-04-26T21:50:36.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 94631 0.75 MB/sec execute 549 sec latency 47.005 ms 2024-04-26T21:50:37.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 94725 0.75 MB/sec execute 550 sec latency 50.613 ms 2024-04-26T21:50:38.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 94870 0.75 MB/sec execute 551 sec latency 45.251 ms 2024-04-26T21:50:39.596 INFO:tasks.workunit.client.0.smithi005.stdout: 1 95163 0.76 MB/sec execute 552 sec latency 47.122 ms 2024-04-26T21:50:40.597 INFO:tasks.workunit.client.0.smithi005.stdout: 1 95298 0.76 MB/sec execute 553 sec latency 52.383 ms 2024-04-26T21:50:41.597 INFO:tasks.workunit.client.0.smithi005.stdout: 1 95557 0.76 MB/sec execute 554 sec latency 58.339 ms 2024-04-26T21:50:42.597 INFO:tasks.workunit.client.0.smithi005.stdout: 1 95587 0.76 MB/sec execute 555 sec latency 49.615 ms 2024-04-26T21:50:43.597 INFO:tasks.workunit.client.0.smithi005.stdout: 1 95645 0.76 MB/sec execute 556 sec latency 50.046 ms 2024-04-26T21:50:44.597 INFO:tasks.workunit.client.0.smithi005.stdout: 1 95875 0.76 MB/sec execute 557 sec latency 52.239 ms 2024-04-26T21:50:45.597 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96025 0.76 MB/sec execute 558 sec latency 50.969 ms 2024-04-26T21:50:46.598 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96110 0.76 MB/sec execute 559 sec latency 29.393 ms 2024-04-26T21:50:47.598 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96196 0.76 MB/sec execute 560 sec latency 51.450 ms 2024-04-26T21:50:48.598 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96281 0.76 MB/sec execute 561 sec latency 30.204 ms 2024-04-26T21:50:48.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:50:48.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:50:49.598 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96375 0.76 MB/sec execute 562 sec latency 64.901 ms 2024-04-26T21:50:50.598 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96495 0.76 MB/sec execute 563 sec latency 60.358 ms 2024-04-26T21:50:51.598 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96645 0.76 MB/sec execute 564 sec latency 44.735 ms 2024-04-26T21:50:52.598 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96768 0.75 MB/sec execute 565 sec latency 52.532 ms 2024-04-26T21:50:53.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 96938 0.76 MB/sec execute 566 sec latency 50.425 ms 2024-04-26T21:50:54.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97067 0.75 MB/sec execute 567 sec latency 52.741 ms 2024-04-26T21:50:55.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97264 0.76 MB/sec execute 568 sec latency 53.348 ms 2024-04-26T21:50:56.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97396 0.76 MB/sec execute 569 sec latency 50.798 ms 2024-04-26T21:50:57.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97529 0.76 MB/sec execute 570 sec latency 45.205 ms 2024-04-26T21:50:58.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97684 0.75 MB/sec execute 571 sec latency 50.535 ms 2024-04-26T21:50:59.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97854 0.75 MB/sec execute 572 sec latency 48.142 ms 2024-04-26T21:51:00.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97994 0.75 MB/sec execute 573 sec latency 52.018 ms 2024-04-26T21:51:01.599 INFO:tasks.workunit.client.0.smithi005.stdout: 1 98158 0.75 MB/sec execute 574 sec latency 44.908 ms 2024-04-26T21:51:02.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 98253 0.75 MB/sec execute 575 sec latency 52.773 ms 2024-04-26T21:51:03.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 98393 0.75 MB/sec execute 576 sec latency 53.514 ms 2024-04-26T21:51:04.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 98591 0.76 MB/sec execute 577 sec latency 53.804 ms 2024-04-26T21:51:05.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 98809 0.76 MB/sec execute 578 sec latency 51.971 ms 2024-04-26T21:51:06.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99094 0.76 MB/sec execute 579 sec latency 60.223 ms 2024-04-26T21:51:07.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99125 0.76 MB/sec execute 580 sec latency 52.302 ms 2024-04-26T21:51:08.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99150 0.76 MB/sec execute 581 sec latency 55.949 ms 2024-04-26T21:51:09.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99361 0.76 MB/sec execute 582 sec latency 52.757 ms 2024-04-26T21:51:10.600 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99502 0.76 MB/sec execute 583 sec latency 47.594 ms 2024-04-26T21:51:11.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99628 0.76 MB/sec execute 584 sec latency 46.957 ms 2024-04-26T21:51:12.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99719 0.76 MB/sec execute 585 sec latency 46.929 ms 2024-04-26T21:51:13.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99804 0.76 MB/sec execute 586 sec latency 43.872 ms 2024-04-26T21:51:14.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99887 0.76 MB/sec execute 587 sec latency 52.039 ms 2024-04-26T21:51:15.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 99990 0.76 MB/sec execute 588 sec latency 57.392 ms 2024-04-26T21:51:16.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 100152 0.76 MB/sec execute 589 sec latency 53.446 ms 2024-04-26T21:51:17.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 100298 0.75 MB/sec execute 590 sec latency 53.350 ms 2024-04-26T21:51:18.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 100429 0.76 MB/sec execute 591 sec latency 52.169 ms 2024-04-26T21:51:18.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:51:18.779 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:51:19.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 100569 0.75 MB/sec execute 592 sec latency 45.992 ms 2024-04-26T21:51:20.601 INFO:tasks.workunit.client.0.smithi005.stdout: 1 100762 0.76 MB/sec execute 593 sec latency 48.943 ms 2024-04-26T21:51:21.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 100894 0.76 MB/sec execute 594 sec latency 44.385 ms 2024-04-26T21:51:22.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 101022 0.76 MB/sec execute 595 sec latency 47.317 ms 2024-04-26T21:51:23.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 101197 0.76 MB/sec execute 596 sec latency 47.024 ms 2024-04-26T21:51:24.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 101343 0.75 MB/sec execute 597 sec latency 47.330 ms 2024-04-26T21:51:25.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 101501 0.75 MB/sec execute 598 sec latency 50.765 ms 2024-04-26T21:51:26.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 101667 0.75 MB/sec execute 599 sec latency 52.497 ms 2024-04-26T21:51:27.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 cleanup 600 sec 2024-04-26T21:51:28.602 INFO:tasks.workunit.client.0.smithi005.stdout: 1 cleanup 601 sec 2024-04-26T21:51:28.790 INFO:tasks.workunit.client.0.smithi005.stdout: 0 cleanup 601 sec 2024-04-26T21:51:28.790 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-04-26T21:51:28.790 INFO:tasks.workunit.client.0.smithi005.stdout: Operation Count AvgLat MaxLat 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: ---------------------------------------- 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: NTCreateX 14652 12.949 204.347 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Close 10766 0.234 3.711 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Rename 615 32.842 70.363 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Unlink 2960 11.956 329.016 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Qpathinfo 13263 7.276 63.062 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Qfileinfo 2295 0.523 3.648 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Qfsinfo 2422 1.453 6.882 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Sfileinfo 1191 4.020 9.140 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Find 5123 44.501 406.314 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: WriteX 7192 0.960 11.251 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: ReadX 22689 0.015 0.759 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: LockX 46 2.036 2.507 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: UnlockX 46 2.004 2.522 2024-04-26T21:51:28.791 INFO:tasks.workunit.client.0.smithi005.stdout: Flush 1025 9.424 25.676 2024-04-26T21:51:28.792 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-04-26T21:51:28.792 INFO:tasks.workunit.client.0.smithi005.stdout:Throughput 0.753605 MB/sec 1 clients 1 procs max_latency=406.327 ms 2024-04-26T21:51:28.792 INFO:tasks.workunit.client.0.smithi005.stderr:+ dbench 10 2024-04-26T21:51:28.794 INFO:tasks.workunit.client.0.smithi005.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-26T21:51:28.794 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-04-26T21:51:28.794 INFO:tasks.workunit.client.0.smithi005.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-26T21:51:28.798 INFO:tasks.workunit.client.0.smithi005.stdout:8 of 10 processes prepared for launch 0 sec 2024-04-26T21:51:28.898 INFO:tasks.workunit.client.0.smithi005.stdout:10 of 10 processes prepared for launch 0 sec 2024-04-26T21:51:28.898 INFO:tasks.workunit.client.0.smithi005.stdout:releasing clients 2024-04-26T21:51:29.898 INFO:tasks.workunit.client.0.smithi005.stdout: 10 173 70.69 MB/sec warmup 1 sec latency 61.500 ms 2024-04-26T21:51:30.898 INFO:tasks.workunit.client.0.smithi005.stdout: 10 340 61.42 MB/sec warmup 2 sec latency 67.592 ms 2024-04-26T21:51:31.898 INFO:tasks.workunit.client.0.smithi005.stdout: 10 512 59.37 MB/sec warmup 3 sec latency 52.985 ms 2024-04-26T21:51:32.898 INFO:tasks.workunit.client.0.smithi005.stdout: 10 683 52.98 MB/sec warmup 4 sec latency 95.666 ms 2024-04-26T21:51:33.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 812 42.97 MB/sec warmup 5 sec latency 124.234 ms 2024-04-26T21:51:34.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 864 36.01 MB/sec warmup 6 sec latency 501.991 ms 2024-04-26T21:51:35.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 944 31.14 MB/sec warmup 7 sec latency 178.293 ms 2024-04-26T21:51:36.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1044 28.61 MB/sec warmup 8 sec latency 258.131 ms 2024-04-26T21:51:37.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1142 25.55 MB/sec warmup 9 sec latency 92.547 ms 2024-04-26T21:51:38.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1252 23.38 MB/sec warmup 10 sec latency 119.005 ms 2024-04-26T21:51:39.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1410 23.64 MB/sec warmup 11 sec latency 98.472 ms 2024-04-26T21:51:40.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1517 21.73 MB/sec warmup 12 sec latency 116.331 ms 2024-04-26T21:51:41.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1632 20.14 MB/sec warmup 13 sec latency 102.270 ms 2024-04-26T21:51:42.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1768 18.78 MB/sec warmup 14 sec latency 87.914 ms 2024-04-26T21:51:43.899 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1900 17.59 MB/sec warmup 15 sec latency 84.195 ms 2024-04-26T21:51:44.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2038 16.61 MB/sec warmup 16 sec latency 91.301 ms 2024-04-26T21:51:45.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2165 15.78 MB/sec warmup 17 sec latency 88.035 ms 2024-04-26T21:51:46.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2311 15.34 MB/sec warmup 18 sec latency 114.108 ms 2024-04-26T21:51:47.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2401 14.76 MB/sec warmup 19 sec latency 90.719 ms 2024-04-26T21:51:48.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2500 14.27 MB/sec warmup 20 sec latency 141.447 ms 2024-04-26T21:51:48.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:51:48.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:51:49.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2545 13.75 MB/sec warmup 21 sec latency 497.976 ms 2024-04-26T21:51:50.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2667 13.61 MB/sec warmup 22 sec latency 284.451 ms 2024-04-26T21:51:51.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2876 14.21 MB/sec warmup 23 sec latency 138.815 ms 2024-04-26T21:51:52.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3055 14.08 MB/sec warmup 24 sec latency 145.856 ms 2024-04-26T21:51:53.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3257 13.97 MB/sec warmup 25 sec latency 110.274 ms 2024-04-26T21:51:54.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3300 13.60 MB/sec warmup 26 sec latency 277.579 ms 2024-04-26T21:51:55.900 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3309 13.10 MB/sec warmup 27 sec latency 481.237 ms 2024-04-26T21:51:56.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3324 12.63 MB/sec warmup 28 sec latency 140.084 ms 2024-04-26T21:51:57.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3397 12.51 MB/sec warmup 29 sec latency 105.150 ms 2024-04-26T21:51:58.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3537 12.63 MB/sec warmup 30 sec latency 116.721 ms 2024-04-26T21:51:59.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3684 12.58 MB/sec warmup 31 sec latency 118.692 ms 2024-04-26T21:52:00.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3778 12.36 MB/sec warmup 32 sec latency 117.567 ms 2024-04-26T21:52:01.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3844 12.06 MB/sec warmup 33 sec latency 130.853 ms 2024-04-26T21:52:02.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3904 11.75 MB/sec warmup 34 sec latency 125.627 ms 2024-04-26T21:52:03.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3961 11.45 MB/sec warmup 35 sec latency 159.385 ms 2024-04-26T21:52:04.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4009 11.13 MB/sec warmup 36 sec latency 158.548 ms 2024-04-26T21:52:05.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4069 10.83 MB/sec warmup 37 sec latency 144.153 ms 2024-04-26T21:52:06.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4126 10.55 MB/sec warmup 38 sec latency 329.155 ms 2024-04-26T21:52:07.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4199 10.30 MB/sec warmup 39 sec latency 272.311 ms 2024-04-26T21:52:08.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4309 10.11 MB/sec warmup 40 sec latency 138.628 ms 2024-04-26T21:52:09.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4398 9.91 MB/sec warmup 41 sec latency 403.205 ms 2024-04-26T21:52:10.901 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4501 9.73 MB/sec warmup 42 sec latency 156.625 ms 2024-04-26T21:52:11.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4628 9.77 MB/sec warmup 43 sec latency 99.866 ms 2024-04-26T21:52:12.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4743 9.58 MB/sec warmup 44 sec latency 94.382 ms 2024-04-26T21:52:13.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4879 9.64 MB/sec warmup 45 sec latency 96.715 ms 2024-04-26T21:52:14.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5016 9.81 MB/sec warmup 46 sec latency 122.762 ms 2024-04-26T21:52:15.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5132 9.63 MB/sec warmup 47 sec latency 105.822 ms 2024-04-26T21:52:16.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5261 9.45 MB/sec warmup 48 sec latency 103.197 ms 2024-04-26T21:52:17.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5407 9.28 MB/sec warmup 49 sec latency 87.987 ms 2024-04-26T21:52:18.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5541 9.12 MB/sec warmup 50 sec latency 82.428 ms 2024-04-26T21:52:19.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5674 8.98 MB/sec warmup 51 sec latency 96.767 ms 2024-04-26T21:52:20.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:52:20.292 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:52:20.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5769 8.84 MB/sec warmup 52 sec latency 305.403 ms 2024-04-26T21:52:21.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5862 8.81 MB/sec warmup 53 sec latency 478.077 ms 2024-04-26T21:52:22.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5941 8.72 MB/sec warmup 54 sec latency 104.174 ms 2024-04-26T21:52:23.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6031 8.64 MB/sec warmup 55 sec latency 105.672 ms 2024-04-26T21:52:24.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6154 8.64 MB/sec warmup 56 sec latency 123.628 ms 2024-04-26T21:52:25.902 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6345 8.99 MB/sec warmup 57 sec latency 131.801 ms 2024-04-26T21:52:26.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6508 9.06 MB/sec warmup 58 sec latency 157.547 ms 2024-04-26T21:52:27.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6682 9.04 MB/sec warmup 59 sec latency 145.217 ms 2024-04-26T21:52:28.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6844 9.08 MB/sec warmup 60 sec latency 100.977 ms 2024-04-26T21:52:29.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6868 8.93 MB/sec warmup 61 sec latency 80.892 ms 2024-04-26T21:52:30.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6890 8.79 MB/sec warmup 62 sec latency 92.507 ms 2024-04-26T21:52:31.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7004 8.85 MB/sec warmup 63 sec latency 106.717 ms 2024-04-26T21:52:32.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7157 9.01 MB/sec warmup 64 sec latency 106.747 ms 2024-04-26T21:52:33.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7281 8.98 MB/sec warmup 65 sec latency 121.195 ms 2024-04-26T21:52:34.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7360 8.92 MB/sec warmup 66 sec latency 117.331 ms 2024-04-26T21:52:35.903 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7419 8.80 MB/sec warmup 67 sec latency 105.665 ms 2024-04-26T21:52:36.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7479 8.70 MB/sec warmup 68 sec latency 122.454 ms 2024-04-26T21:52:37.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7532 8.58 MB/sec warmup 69 sec latency 112.011 ms 2024-04-26T21:52:38.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7591 8.46 MB/sec warmup 70 sec latency 146.948 ms 2024-04-26T21:52:39.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7657 8.34 MB/sec warmup 71 sec latency 261.601 ms 2024-04-26T21:52:40.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7712 8.23 MB/sec warmup 72 sec latency 490.153 ms 2024-04-26T21:52:41.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7754 8.12 MB/sec warmup 73 sec latency 587.356 ms 2024-04-26T21:52:42.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7867 8.05 MB/sec warmup 74 sec latency 162.584 ms 2024-04-26T21:52:43.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7977 7.98 MB/sec warmup 75 sec latency 125.369 ms 2024-04-26T21:52:44.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8090 7.94 MB/sec warmup 76 sec latency 101.410 ms 2024-04-26T21:52:45.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8210 7.95 MB/sec warmup 77 sec latency 94.661 ms 2024-04-26T21:52:46.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8294 7.85 MB/sec warmup 78 sec latency 401.136 ms 2024-04-26T21:52:47.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8430 7.95 MB/sec warmup 79 sec latency 110.270 ms 2024-04-26T21:52:48.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8559 8.03 MB/sec warmup 80 sec latency 109.338 ms 2024-04-26T21:52:49.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8665 7.94 MB/sec warmup 81 sec latency 114.087 ms 2024-04-26T21:52:50.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8748 7.86 MB/sec warmup 82 sec latency 358.665 ms 2024-04-26T21:52:51.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:52:51.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:52:51.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8851 7.77 MB/sec warmup 83 sec latency 540.358 ms 2024-04-26T21:52:52.904 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8974 7.69 MB/sec warmup 84 sec latency 100.180 ms 2024-04-26T21:52:53.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9107 7.62 MB/sec warmup 85 sec latency 89.996 ms 2024-04-26T21:52:54.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9235 7.55 MB/sec warmup 86 sec latency 109.642 ms 2024-04-26T21:52:55.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9378 7.54 MB/sec warmup 87 sec latency 86.553 ms 2024-04-26T21:52:56.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9453 7.51 MB/sec warmup 88 sec latency 435.586 ms 2024-04-26T21:52:57.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9539 7.47 MB/sec warmup 89 sec latency 110.566 ms 2024-04-26T21:52:58.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9655 7.46 MB/sec warmup 90 sec latency 110.027 ms 2024-04-26T21:52:59.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9818 7.59 MB/sec warmup 91 sec latency 107.024 ms 2024-04-26T21:53:00.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10047 7.76 MB/sec warmup 92 sec latency 99.710 ms 2024-04-26T21:53:01.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10217 7.77 MB/sec warmup 93 sec latency 159.889 ms 2024-04-26T21:53:02.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10382 7.83 MB/sec warmup 94 sec latency 129.888 ms 2024-04-26T21:53:03.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10407 7.75 MB/sec warmup 95 sec latency 100.016 ms 2024-04-26T21:53:04.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10424 7.67 MB/sec warmup 96 sec latency 93.214 ms 2024-04-26T21:53:05.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10496 7.66 MB/sec warmup 97 sec latency 92.642 ms 2024-04-26T21:53:06.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10673 7.83 MB/sec warmup 98 sec latency 89.669 ms 2024-04-26T21:53:07.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10800 7.81 MB/sec warmup 99 sec latency 103.606 ms 2024-04-26T21:53:08.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10891 7.80 MB/sec warmup 100 sec latency 121.167 ms 2024-04-26T21:53:09.906 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10950 7.73 MB/sec warmup 101 sec latency 118.194 ms 2024-04-26T21:53:10.905 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11015 7.67 MB/sec warmup 102 sec latency 130.435 ms 2024-04-26T21:53:11.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11072 7.60 MB/sec warmup 103 sec latency 135.869 ms 2024-04-26T21:53:12.906 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11128 7.53 MB/sec warmup 104 sec latency 227.327 ms 2024-04-26T21:53:13.906 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11195 7.46 MB/sec warmup 105 sec latency 171.252 ms 2024-04-26T21:53:14.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11241 7.39 MB/sec warmup 106 sec latency 309.069 ms 2024-04-26T21:53:15.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11337 7.34 MB/sec warmup 107 sec latency 210.479 ms 2024-04-26T21:53:16.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11456 7.30 MB/sec warmup 108 sec latency 134.226 ms 2024-04-26T21:53:17.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11568 7.25 MB/sec warmup 109 sec latency 148.131 ms 2024-04-26T21:53:18.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11688 7.27 MB/sec warmup 110 sec latency 93.009 ms 2024-04-26T21:53:19.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11813 7.24 MB/sec warmup 111 sec latency 97.017 ms 2024-04-26T21:53:20.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11975 7.32 MB/sec warmup 112 sec latency 90.561 ms 2024-04-26T21:53:21.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12112 7.38 MB/sec warmup 113 sec latency 93.897 ms 2024-04-26T21:53:22.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:53:22.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:53:22.554 INFO:tasks.ceph.mds.b.smithi112.stderr:2024-04-26T21:53:22.554+0000 7fc6f2c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39026) UID: 0 2024-04-26T21:53:22.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12224 7.32 MB/sec warmup 114 sec latency 107.999 ms 2024-04-26T21:53:23.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12343 7.27 MB/sec warmup 115 sec latency 115.346 ms 2024-04-26T21:53:24.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12490 7.22 MB/sec warmup 116 sec latency 77.810 ms 2024-04-26T21:53:25.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12616 7.16 MB/sec warmup 117 sec latency 111.414 ms 2024-04-26T21:53:26.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12740 7.12 MB/sec warmup 118 sec latency 105.220 ms 2024-04-26T21:53:27.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12826 7.07 MB/sec warmup 119 sec latency 402.933 ms 2024-04-26T21:53:29.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13057 4.37 MB/sec execute 1 sec latency 442.728 ms 2024-04-26T21:53:30.907 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13158 4.98 MB/sec execute 2 sec latency 96.791 ms 2024-04-26T21:53:31.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13240 5.34 MB/sec execute 3 sec latency 302.653 ms 2024-04-26T21:53:32.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13380 9.01 MB/sec execute 4 sec latency 476.440 ms 2024-04-26T21:53:33.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13568 10.89 MB/sec execute 5 sec latency 130.951 ms 2024-04-26T21:53:34.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13779 10.77 MB/sec execute 6 sec latency 128.861 ms 2024-04-26T21:53:35.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13923 10.73 MB/sec execute 7 sec latency 94.870 ms 2024-04-26T21:53:36.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13955 9.66 MB/sec execute 8 sec latency 101.202 ms 2024-04-26T21:53:37.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13967 8.60 MB/sec execute 9 sec latency 512.366 ms 2024-04-26T21:53:38.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13991 7.76 MB/sec execute 10 sec latency 91.023 ms 2024-04-26T21:53:39.908 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14132 8.98 MB/sec execute 11 sec latency 109.315 ms 2024-04-26T21:53:40.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14280 9.24 MB/sec execute 12 sec latency 115.076 ms 2024-04-26T21:53:41.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14396 9.10 MB/sec execute 13 sec latency 98.973 ms 2024-04-26T21:53:42.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14477 8.69 MB/sec execute 14 sec latency 98.363 ms 2024-04-26T21:53:43.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14541 8.23 MB/sec execute 15 sec latency 123.466 ms 2024-04-26T21:53:44.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14595 7.77 MB/sec execute 16 sec latency 153.658 ms 2024-04-26T21:53:45.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14658 7.32 MB/sec execute 17 sec latency 109.869 ms 2024-04-26T21:53:46.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14725 6.92 MB/sec execute 18 sec latency 168.026 ms 2024-04-26T21:53:47.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14798 6.57 MB/sec execute 19 sec latency 272.495 ms 2024-04-26T21:53:48.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14852 6.29 MB/sec execute 20 sec latency 461.954 ms 2024-04-26T21:53:49.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14953 6.10 MB/sec execute 21 sec latency 152.069 ms 2024-04-26T21:53:50.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15072 5.95 MB/sec execute 22 sec latency 145.194 ms 2024-04-26T21:53:51.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15177 5.89 MB/sec execute 23 sec latency 107.585 ms 2024-04-26T21:53:52.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15294 5.97 MB/sec execute 24 sec latency 105.716 ms 2024-04-26T21:53:53.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15420 5.93 MB/sec execute 25 sec latency 97.626 ms 2024-04-26T21:53:54.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15580 6.51 MB/sec execute 26 sec latency 101.841 ms 2024-04-26T21:53:55.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15705 6.50 MB/sec execute 27 sec latency 92.735 ms 2024-04-26T21:53:56.909 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15825 6.31 MB/sec execute 28 sec latency 104.100 ms 2024-04-26T21:53:57.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15905 6.11 MB/sec execute 29 sec latency 485.967 ms 2024-04-26T21:53:58.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16046 5.95 MB/sec execute 30 sec latency 533.625 ms 2024-04-26T21:53:59.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16175 5.80 MB/sec execute 31 sec latency 89.619 ms 2024-04-26T21:54:00.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16306 5.70 MB/sec execute 32 sec latency 113.824 ms 2024-04-26T21:54:01.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16437 5.63 MB/sec execute 33 sec latency 87.071 ms 2024-04-26T21:54:02.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16549 5.70 MB/sec execute 34 sec latency 130.437 ms 2024-04-26T21:54:03.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16603 5.59 MB/sec execute 35 sec latency 449.311 ms 2024-04-26T21:54:04.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16700 5.60 MB/sec execute 36 sec latency 91.726 ms 2024-04-26T21:54:05.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16839 5.79 MB/sec execute 37 sec latency 109.303 ms 2024-04-26T21:54:06.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17011 6.29 MB/sec execute 38 sec latency 113.051 ms 2024-04-26T21:54:07.910 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17192 6.43 MB/sec execute 39 sec latency 157.528 ms 2024-04-26T21:54:08.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17281 6.40 MB/sec execute 40 sec latency 463.286 ms 2024-04-26T21:54:09.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17477 6.55 MB/sec execute 41 sec latency 97.407 ms 2024-04-26T21:54:10.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17503 6.39 MB/sec execute 42 sec latency 100.273 ms 2024-04-26T21:54:11.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17523 6.25 MB/sec execute 43 sec latency 112.716 ms 2024-04-26T21:54:12.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17592 6.31 MB/sec execute 44 sec latency 109.726 ms 2024-04-26T21:54:13.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17638 6.19 MB/sec execute 45 sec latency 537.129 ms 2024-04-26T21:54:14.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17812 6.56 MB/sec execute 46 sec latency 122.587 ms 2024-04-26T21:54:15.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17931 6.56 MB/sec execute 47 sec latency 95.074 ms 2024-04-26T21:54:16.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18011 6.52 MB/sec execute 48 sec latency 148.629 ms 2024-04-26T21:54:17.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18081 6.41 MB/sec execute 49 sec latency 121.418 ms 2024-04-26T21:54:18.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18143 6.31 MB/sec execute 50 sec latency 116.002 ms 2024-04-26T21:54:19.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18193 6.19 MB/sec execute 51 sec latency 216.092 ms 2024-04-26T21:54:20.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18260 6.07 MB/sec execute 52 sec latency 161.652 ms 2024-04-26T21:54:21.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18349 5.97 MB/sec execute 53 sec latency 207.954 ms 2024-04-26T21:54:22.911 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18447 5.89 MB/sec execute 54 sec latency 149.315 ms 2024-04-26T21:54:23.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18561 5.83 MB/sec execute 55 sec latency 126.691 ms 2024-04-26T21:54:24.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18688 5.80 MB/sec execute 56 sec latency 103.997 ms 2024-04-26T21:54:25.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18804 5.83 MB/sec execute 57 sec latency 93.855 ms 2024-04-26T21:54:26.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18927 5.85 MB/sec execute 58 sec latency 110.213 ms 2024-04-26T21:54:27.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19056 5.86 MB/sec execute 59 sec latency 97.711 ms 2024-04-26T21:54:28.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19209 6.11 MB/sec execute 60 sec latency 107.972 ms 2024-04-26T21:54:29.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19328 6.02 MB/sec execute 61 sec latency 111.096 ms 2024-04-26T21:54:30.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19446 5.94 MB/sec execute 62 sec latency 103.407 ms 2024-04-26T21:54:31.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19598 5.87 MB/sec execute 63 sec latency 101.091 ms 2024-04-26T21:54:32.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19721 5.80 MB/sec execute 64 sec latency 80.142 ms 2024-04-26T21:54:33.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19862 5.75 MB/sec execute 65 sec latency 99.947 ms 2024-04-26T21:54:34.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20005 5.72 MB/sec execute 66 sec latency 109.785 ms 2024-04-26T21:54:35.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20149 5.77 MB/sec execute 67 sec latency 84.845 ms 2024-04-26T21:54:36.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20230 5.73 MB/sec execute 68 sec latency 117.381 ms 2024-04-26T21:54:37.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20366 5.80 MB/sec execute 69 sec latency 128.742 ms 2024-04-26T21:54:38.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20539 5.96 MB/sec execute 70 sec latency 111.171 ms 2024-04-26T21:54:39.912 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20758 6.21 MB/sec execute 71 sec latency 124.043 ms 2024-04-26T21:54:40.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20948 6.25 MB/sec execute 72 sec latency 142.100 ms 2024-04-26T21:54:41.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21075 6.30 MB/sec execute 73 sec latency 100.546 ms 2024-04-26T21:54:42.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21103 6.22 MB/sec execute 74 sec latency 84.192 ms 2024-04-26T21:54:43.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21136 6.18 MB/sec execute 75 sec latency 394.618 ms 2024-04-26T21:54:44.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21211 6.19 MB/sec execute 76 sec latency 493.198 ms 2024-04-26T21:54:45.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21386 6.40 MB/sec execute 77 sec latency 104.593 ms 2024-04-26T21:54:46.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21499 6.39 MB/sec execute 78 sec latency 122.732 ms 2024-04-26T21:54:47.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21593 6.39 MB/sec execute 79 sec latency 126.145 ms 2024-04-26T21:54:48.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21639 6.31 MB/sec execute 80 sec latency 316.539 ms 2024-04-26T21:54:49.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21668 6.24 MB/sec execute 81 sec latency 830.427 ms 2024-04-26T21:54:50.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21733 6.19 MB/sec execute 82 sec latency 166.890 ms 2024-04-26T21:54:51.913 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21795 6.11 MB/sec execute 83 sec latency 107.778 ms 2024-04-26T21:54:52.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21871 6.05 MB/sec execute 84 sec latency 146.901 ms 2024-04-26T21:54:53.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21953 5.98 MB/sec execute 85 sec latency 141.017 ms 2024-04-26T21:54:54.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22008 5.92 MB/sec execute 86 sec latency 509.536 ms 2024-04-26T21:54:55.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22102 5.88 MB/sec execute 87 sec latency 200.903 ms 2024-04-26T21:54:56.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22213 5.85 MB/sec execute 88 sec latency 144.904 ms 2024-04-26T21:54:57.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22323 5.83 MB/sec execute 89 sec latency 93.919 ms 2024-04-26T21:54:58.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22450 5.89 MB/sec execute 90 sec latency 106.855 ms 2024-04-26T21:54:59.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22524 5.83 MB/sec execute 91 sec latency 429.096 ms 2024-04-26T21:55:00.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22645 5.84 MB/sec execute 92 sec latency 111.125 ms 2024-04-26T21:55:01.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22808 6.00 MB/sec execute 93 sec latency 91.512 ms 2024-04-26T21:55:02.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22923 5.95 MB/sec execute 94 sec latency 97.297 ms 2024-04-26T21:55:03.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23050 5.90 MB/sec execute 95 sec latency 98.722 ms 2024-04-26T21:55:04.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23190 5.85 MB/sec execute 96 sec latency 96.981 ms 2024-04-26T21:55:05.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23324 5.81 MB/sec execute 97 sec latency 99.210 ms 2024-04-26T21:55:06.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23452 5.77 MB/sec execute 98 sec latency 107.394 ms 2024-04-26T21:55:07.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23594 5.75 MB/sec execute 99 sec latency 99.901 ms 2024-04-26T21:55:08.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23715 5.78 MB/sec execute 100 sec latency 98.601 ms 2024-04-26T21:55:09.914 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23808 5.78 MB/sec execute 101 sec latency 229.172 ms 2024-04-26T21:55:10.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23930 5.83 MB/sec execute 102 sec latency 119.100 ms 2024-04-26T21:55:11.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24093 5.94 MB/sec execute 103 sec latency 132.830 ms 2024-04-26T21:55:12.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24308 6.07 MB/sec execute 104 sec latency 101.345 ms 2024-04-26T21:55:13.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24448 6.09 MB/sec execute 105 sec latency 147.576 ms 2024-04-26T21:55:14.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24612 6.15 MB/sec execute 106 sec latency 143.877 ms 2024-04-26T21:55:15.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24657 6.12 MB/sec execute 107 sec latency 96.565 ms 2024-04-26T21:55:16.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24694 6.07 MB/sec execute 108 sec latency 98.636 ms 2024-04-26T21:55:17.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24774 6.08 MB/sec execute 109 sec latency 99.846 ms 2024-04-26T21:55:18.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 24942 6.22 MB/sec execute 110 sec latency 106.040 ms 2024-04-26T21:55:19.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25055 6.21 MB/sec execute 111 sec latency 105.018 ms 2024-04-26T21:55:20.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25149 6.21 MB/sec execute 112 sec latency 136.865 ms 2024-04-26T21:55:21.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25212 6.16 MB/sec execute 113 sec latency 132.921 ms 2024-04-26T21:55:22.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25287 6.13 MB/sec execute 114 sec latency 154.568 ms 2024-04-26T21:55:23.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25343 6.08 MB/sec execute 115 sec latency 173.119 ms 2024-04-26T21:55:24.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25386 6.03 MB/sec execute 116 sec latency 295.205 ms 2024-04-26T21:55:25.915 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25462 5.98 MB/sec execute 117 sec latency 182.918 ms 2024-04-26T21:55:26.916 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25536 5.93 MB/sec execute 118 sec latency 215.509 ms 2024-04-26T21:55:27.916 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25646 5.91 MB/sec execute 119 sec latency 151.640 ms 2024-04-26T21:55:28.916 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25762 5.89 MB/sec execute 120 sec latency 117.635 ms 2024-04-26T21:55:29.916 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25835 5.86 MB/sec execute 121 sec latency 345.929 ms 2024-04-26T21:55:30.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 25949 5.88 MB/sec execute 122 sec latency 349.518 ms 2024-04-26T21:55:31.916 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26053 5.87 MB/sec execute 123 sec latency 122.535 ms 2024-04-26T21:55:32.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26181 5.88 MB/sec execute 124 sec latency 103.896 ms 2024-04-26T21:55:33.916 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26340 6.00 MB/sec execute 125 sec latency 85.933 ms 2024-04-26T21:55:34.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26458 5.96 MB/sec execute 126 sec latency 103.077 ms 2024-04-26T21:55:35.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26582 5.92 MB/sec execute 127 sec latency 94.368 ms 2024-04-26T21:55:36.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26721 5.88 MB/sec execute 128 sec latency 126.797 ms 2024-04-26T21:55:37.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26845 5.84 MB/sec execute 129 sec latency 94.070 ms 2024-04-26T21:55:38.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 26987 5.82 MB/sec execute 130 sec latency 100.364 ms 2024-04-26T21:55:39.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27107 5.80 MB/sec execute 131 sec latency 131.368 ms 2024-04-26T21:55:40.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27237 5.82 MB/sec execute 132 sec latency 99.864 ms 2024-04-26T21:55:41.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27331 5.82 MB/sec execute 133 sec latency 92.077 ms 2024-04-26T21:55:42.917 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27448 5.85 MB/sec execute 134 sec latency 105.681 ms 2024-04-26T21:55:43.918 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27553 5.85 MB/sec execute 135 sec latency 352.583 ms 2024-04-26T21:55:44.918 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27719 5.99 MB/sec execute 136 sec latency 125.729 ms 2024-04-26T21:55:45.918 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27894 6.04 MB/sec execute 137 sec latency 147.570 ms 2024-04-26T21:55:46.919 INFO:tasks.workunit.client.0.smithi005.stdout: 10 27968 6.01 MB/sec execute 138 sec latency 187.694 ms 2024-04-26T21:55:47.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28162 6.06 MB/sec execute 139 sec latency 109.229 ms 2024-04-26T21:55:48.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28190 6.04 MB/sec execute 140 sec latency 284.961 ms 2024-04-26T21:55:49.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28232 6.00 MB/sec execute 141 sec latency 89.793 ms 2024-04-26T21:55:50.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28302 6.01 MB/sec execute 142 sec latency 91.503 ms 2024-04-26T21:55:51.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28449 6.11 MB/sec execute 143 sec latency 111.422 ms 2024-04-26T21:55:52.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28572 6.11 MB/sec execute 144 sec latency 85.208 ms 2024-04-26T21:55:53.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28619 6.07 MB/sec execute 145 sec latency 478.193 ms 2024-04-26T21:55:54.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28705 6.08 MB/sec execute 146 sec latency 125.984 ms 2024-04-26T21:55:55.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28768 6.04 MB/sec execute 147 sec latency 130.208 ms 2024-04-26T21:55:56.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28832 6.01 MB/sec execute 148 sec latency 149.735 ms 2024-04-26T21:55:57.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28893 5.97 MB/sec execute 149 sec latency 168.203 ms 2024-04-26T21:55:58.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:55:58.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:55:58.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 28949 5.93 MB/sec execute 150 sec latency 157.815 ms 2024-04-26T21:55:59.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29039 5.90 MB/sec execute 151 sec latency 143.487 ms 2024-04-26T21:56:00.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29127 5.87 MB/sec execute 152 sec latency 245.198 ms 2024-04-26T21:56:01.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29237 5.86 MB/sec execute 153 sec latency 98.859 ms 2024-04-26T21:56:02.920 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29351 5.84 MB/sec execute 154 sec latency 190.030 ms 2024-04-26T21:56:03.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29423 5.82 MB/sec execute 155 sec latency 417.800 ms 2024-04-26T21:56:04.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29548 5.85 MB/sec execute 156 sec latency 102.891 ms 2024-04-26T21:56:05.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29675 5.86 MB/sec execute 157 sec latency 83.349 ms 2024-04-26T21:56:06.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29785 5.83 MB/sec execute 158 sec latency 132.991 ms 2024-04-26T21:56:07.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 29938 5.92 MB/sec execute 159 sec latency 88.489 ms 2024-04-26T21:56:08.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30003 5.88 MB/sec execute 160 sec latency 416.752 ms 2024-04-26T21:56:09.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30117 5.85 MB/sec execute 161 sec latency 119.791 ms 2024-04-26T21:56:10.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30249 5.83 MB/sec execute 162 sec latency 106.856 ms 2024-04-26T21:56:11.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30363 5.80 MB/sec execute 163 sec latency 153.028 ms 2024-04-26T21:56:12.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30478 5.77 MB/sec execute 164 sec latency 141.559 ms 2024-04-26T21:56:13.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30594 5.76 MB/sec execute 165 sec latency 114.613 ms 2024-04-26T21:56:14.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30713 5.74 MB/sec execute 166 sec latency 122.320 ms 2024-04-26T21:56:15.921 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30857 5.78 MB/sec execute 167 sec latency 93.445 ms 2024-04-26T21:56:16.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 30953 5.78 MB/sec execute 168 sec latency 105.134 ms 2024-04-26T21:56:17.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31114 5.83 MB/sec execute 169 sec latency 103.124 ms 2024-04-26T21:56:18.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31236 5.84 MB/sec execute 170 sec latency 88.815 ms 2024-04-26T21:56:19.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31447 5.96 MB/sec execute 171 sec latency 108.902 ms 2024-04-26T21:56:20.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31552 5.94 MB/sec execute 172 sec latency 135.029 ms 2024-04-26T21:56:21.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31732 5.99 MB/sec execute 173 sec latency 105.748 ms 2024-04-26T21:56:22.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31773 5.96 MB/sec execute 174 sec latency 94.173 ms 2024-04-26T21:56:23.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31834 5.97 MB/sec execute 175 sec latency 95.660 ms 2024-04-26T21:56:24.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 31892 5.94 MB/sec execute 176 sec latency 94.001 ms 2024-04-26T21:56:25.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32042 6.04 MB/sec execute 177 sec latency 120.233 ms 2024-04-26T21:56:26.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32137 6.01 MB/sec execute 178 sec latency 120.733 ms 2024-04-26T21:56:27.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32241 6.03 MB/sec execute 179 sec latency 132.132 ms 2024-04-26T21:56:28.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:56:28.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:56:28.922 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32303 5.99 MB/sec execute 180 sec latency 100.453 ms 2024-04-26T21:56:29.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32368 5.97 MB/sec execute 181 sec latency 90.727 ms 2024-04-26T21:56:30.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32434 5.94 MB/sec execute 182 sec latency 171.145 ms 2024-04-26T21:56:31.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32495 5.91 MB/sec execute 183 sec latency 134.627 ms 2024-04-26T21:56:32.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32565 5.88 MB/sec execute 184 sec latency 128.427 ms 2024-04-26T21:56:33.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32646 5.86 MB/sec execute 185 sec latency 252.827 ms 2024-04-26T21:56:34.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32736 5.84 MB/sec execute 186 sec latency 215.402 ms 2024-04-26T21:56:35.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32859 5.83 MB/sec execute 187 sec latency 107.681 ms 2024-04-26T21:56:36.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 32969 5.83 MB/sec execute 188 sec latency 184.318 ms 2024-04-26T21:56:37.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33087 5.82 MB/sec execute 189 sec latency 103.738 ms 2024-04-26T21:56:38.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33161 5.84 MB/sec execute 190 sec latency 411.189 ms 2024-04-26T21:56:39.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33269 5.82 MB/sec execute 191 sec latency 106.962 ms 2024-04-26T21:56:40.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33398 5.84 MB/sec execute 192 sec latency 98.929 ms 2024-04-26T21:56:41.923 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33528 5.87 MB/sec execute 193 sec latency 98.810 ms 2024-04-26T21:56:42.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33647 5.84 MB/sec execute 194 sec latency 96.475 ms 2024-04-26T21:56:43.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33683 5.82 MB/sec execute 195 sec latency 695.176 ms 2024-04-26T21:56:44.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33804 5.79 MB/sec execute 196 sec latency 718.102 ms 2024-04-26T21:56:45.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 33931 5.77 MB/sec execute 197 sec latency 122.011 ms 2024-04-26T21:56:46.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 34069 5.76 MB/sec execute 198 sec latency 122.908 ms 2024-04-26T21:56:47.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 34175 5.74 MB/sec execute 199 sec latency 126.247 ms 2024-04-26T21:56:48.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 34328 5.76 MB/sec execute 200 sec latency 86.104 ms 2024-04-26T21:56:49.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 34441 5.76 MB/sec execute 201 sec latency 88.644 ms 2024-04-26T21:56:50.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 34573 5.79 MB/sec execute 202 sec latency 103.504 ms 2024-04-26T21:56:51.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 34708 5.80 MB/sec execute 203 sec latency 101.753 ms 2024-04-26T21:56:52.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 34914 5.90 MB/sec execute 204 sec latency 125.569 ms 2024-04-26T21:56:53.924 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35042 5.91 MB/sec execute 205 sec latency 120.343 ms 2024-04-26T21:56:54.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35167 5.91 MB/sec execute 206 sec latency 473.387 ms 2024-04-26T21:56:55.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35288 5.93 MB/sec execute 207 sec latency 83.752 ms 2024-04-26T21:56:56.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35336 5.91 MB/sec execute 208 sec latency 119.113 ms 2024-04-26T21:56:57.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35402 5.91 MB/sec execute 209 sec latency 102.639 ms 2024-04-26T21:56:58.277 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:56:58.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:56:58.364 INFO:tasks.ceph.mds.b.smithi112.stderr:2024-04-26T21:56:58.363+0000 7fc6f2c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39091) UID: 0 2024-04-26T21:56:58.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35492 5.93 MB/sec execute 210 sec latency 84.500 ms 2024-04-26T21:56:59.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35631 5.97 MB/sec execute 211 sec latency 118.782 ms 2024-04-26T21:57:00.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35735 5.97 MB/sec execute 212 sec latency 139.122 ms 2024-04-26T21:57:01.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35822 5.96 MB/sec execute 213 sec latency 93.809 ms 2024-04-26T21:57:02.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35888 5.94 MB/sec execute 214 sec latency 89.831 ms 2024-04-26T21:57:03.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 35964 5.92 MB/sec execute 215 sec latency 115.348 ms 2024-04-26T21:57:04.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36034 5.89 MB/sec execute 216 sec latency 126.730 ms 2024-04-26T21:57:05.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36110 5.87 MB/sec execute 217 sec latency 119.666 ms 2024-04-26T21:57:06.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36186 5.85 MB/sec execute 218 sec latency 235.916 ms 2024-04-26T21:57:07.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36269 5.83 MB/sec execute 219 sec latency 253.044 ms 2024-04-26T21:57:08.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36382 5.82 MB/sec execute 220 sec latency 132.577 ms 2024-04-26T21:57:09.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36503 5.82 MB/sec execute 221 sec latency 122.337 ms 2024-04-26T21:57:10.925 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36606 5.81 MB/sec execute 222 sec latency 116.413 ms 2024-04-26T21:57:11.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36738 5.84 MB/sec execute 223 sec latency 91.338 ms 2024-04-26T21:57:12.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36854 5.82 MB/sec execute 224 sec latency 109.877 ms 2024-04-26T21:57:13.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 36997 5.86 MB/sec execute 225 sec latency 98.329 ms 2024-04-26T21:57:14.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 37136 5.86 MB/sec execute 226 sec latency 86.553 ms 2024-04-26T21:57:15.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 37254 5.84 MB/sec execute 227 sec latency 105.240 ms 2024-04-26T21:57:16.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 37380 5.82 MB/sec execute 228 sec latency 141.575 ms 2024-04-26T21:57:17.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 37502 5.80 MB/sec execute 229 sec latency 92.335 ms 2024-04-26T21:57:18.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 37643 5.79 MB/sec execute 230 sec latency 95.750 ms 2024-04-26T21:57:19.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 37762 5.78 MB/sec execute 231 sec latency 89.017 ms 2024-04-26T21:57:20.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 37924 5.80 MB/sec execute 232 sec latency 98.227 ms 2024-04-26T21:57:21.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38029 5.82 MB/sec execute 233 sec latency 105.533 ms 2024-04-26T21:57:22.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38170 5.83 MB/sec execute 234 sec latency 102.465 ms 2024-04-26T21:57:23.926 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38243 5.82 MB/sec execute 235 sec latency 287.283 ms 2024-04-26T21:57:24.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38405 5.87 MB/sec execute 236 sec latency 119.164 ms 2024-04-26T21:57:25.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38558 5.91 MB/sec execute 237 sec latency 132.176 ms 2024-04-26T21:57:26.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38686 5.92 MB/sec execute 238 sec latency 167.422 ms 2024-04-26T21:57:27.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38837 5.94 MB/sec execute 239 sec latency 97.497 ms 2024-04-26T21:57:28.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38911 5.94 MB/sec execute 240 sec latency 84.051 ms 2024-04-26T21:57:29.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 38943 5.92 MB/sec execute 241 sec latency 455.424 ms 2024-04-26T21:57:30.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39027 5.93 MB/sec execute 242 sec latency 97.516 ms 2024-04-26T21:57:31.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39157 5.97 MB/sec execute 243 sec latency 116.642 ms 2024-04-26T21:57:32.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39259 5.97 MB/sec execute 244 sec latency 119.538 ms 2024-04-26T21:57:33.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39339 5.95 MB/sec execute 245 sec latency 114.689 ms 2024-04-26T21:57:34.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39391 5.94 MB/sec execute 246 sec latency 372.558 ms 2024-04-26T21:57:35.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39457 5.92 MB/sec execute 247 sec latency 492.152 ms 2024-04-26T21:57:36.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39529 5.90 MB/sec execute 248 sec latency 161.458 ms 2024-04-26T21:57:37.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39601 5.88 MB/sec execute 249 sec latency 118.081 ms 2024-04-26T21:57:38.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39687 5.87 MB/sec execute 250 sec latency 201.793 ms 2024-04-26T21:57:39.927 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39786 5.85 MB/sec execute 251 sec latency 101.659 ms 2024-04-26T21:57:40.928 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39880 5.84 MB/sec execute 252 sec latency 339.879 ms 2024-04-26T21:57:41.928 INFO:tasks.workunit.client.0.smithi005.stdout: 10 39994 5.83 MB/sec execute 253 sec latency 175.387 ms 2024-04-26T21:57:42.928 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40107 5.82 MB/sec execute 254 sec latency 146.099 ms 2024-04-26T21:57:43.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40187 5.83 MB/sec execute 255 sec latency 405.333 ms 2024-04-26T21:57:44.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40297 5.83 MB/sec execute 256 sec latency 111.898 ms 2024-04-26T21:57:45.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40427 5.82 MB/sec execute 257 sec latency 90.686 ms 2024-04-26T21:57:46.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40554 5.84 MB/sec execute 258 sec latency 117.923 ms 2024-04-26T21:57:47.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40698 5.85 MB/sec execute 259 sec latency 113.231 ms 2024-04-26T21:57:48.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40815 5.83 MB/sec execute 260 sec latency 95.378 ms 2024-04-26T21:57:49.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 40945 5.82 MB/sec execute 261 sec latency 103.057 ms 2024-04-26T21:57:50.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 41039 5.80 MB/sec execute 262 sec latency 409.879 ms 2024-04-26T21:57:51.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 41157 5.79 MB/sec execute 263 sec latency 92.603 ms 2024-04-26T21:57:52.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 41283 5.78 MB/sec execute 264 sec latency 91.795 ms 2024-04-26T21:57:53.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 41406 5.79 MB/sec execute 265 sec latency 108.757 ms 2024-04-26T21:57:54.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 41535 5.79 MB/sec execute 266 sec latency 84.197 ms 2024-04-26T21:57:55.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 41689 5.82 MB/sec execute 267 sec latency 91.219 ms 2024-04-26T21:57:56.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 41806 5.83 MB/sec execute 268 sec latency 106.599 ms 2024-04-26T21:57:57.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42003 5.89 MB/sec execute 269 sec latency 104.676 ms 2024-04-26T21:57:58.930 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42185 5.92 MB/sec execute 270 sec latency 116.277 ms 2024-04-26T21:57:59.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42336 5.93 MB/sec execute 271 sec latency 130.013 ms 2024-04-26T21:58:00.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42412 5.92 MB/sec execute 272 sec latency 118.205 ms 2024-04-26T21:58:01.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42491 5.93 MB/sec execute 273 sec latency 85.742 ms 2024-04-26T21:58:02.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42595 5.95 MB/sec execute 274 sec latency 95.163 ms 2024-04-26T21:58:03.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42702 5.96 MB/sec execute 275 sec latency 149.481 ms 2024-04-26T21:58:04.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42777 5.96 MB/sec execute 276 sec latency 462.268 ms 2024-04-26T21:58:05.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42873 5.95 MB/sec execute 277 sec latency 123.624 ms 2024-04-26T21:58:06.931 INFO:tasks.workunit.client.0.smithi005.stdout: 10 42953 5.94 MB/sec execute 278 sec latency 140.071 ms 2024-04-26T21:58:07.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43018 5.93 MB/sec execute 279 sec latency 163.432 ms 2024-04-26T21:58:08.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43090 5.91 MB/sec execute 280 sec latency 187.420 ms 2024-04-26T21:58:09.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43157 5.89 MB/sec execute 281 sec latency 169.812 ms 2024-04-26T21:58:10.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43237 5.87 MB/sec execute 282 sec latency 170.851 ms 2024-04-26T21:58:11.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43337 5.86 MB/sec execute 283 sec latency 106.277 ms 2024-04-26T21:58:12.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43439 5.85 MB/sec execute 284 sec latency 164.229 ms 2024-04-26T21:58:13.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43552 5.85 MB/sec execute 285 sec latency 150.341 ms 2024-04-26T21:58:14.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43674 5.84 MB/sec execute 286 sec latency 109.533 ms 2024-04-26T21:58:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43810 5.87 MB/sec execute 287 sec latency 95.926 ms 2024-04-26T21:58:16.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 43935 5.86 MB/sec execute 288 sec latency 106.835 ms 2024-04-26T21:58:17.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 44054 5.86 MB/sec execute 289 sec latency 113.423 ms 2024-04-26T21:58:18.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 44207 5.88 MB/sec execute 290 sec latency 97.617 ms 2024-04-26T21:58:19.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 44320 5.87 MB/sec execute 291 sec latency 109.553 ms 2024-04-26T21:58:20.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 44463 5.86 MB/sec execute 292 sec latency 83.554 ms 2024-04-26T21:58:21.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 44597 5.84 MB/sec execute 293 sec latency 86.565 ms 2024-04-26T21:58:22.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 44726 5.83 MB/sec execute 294 sec latency 124.529 ms 2024-04-26T21:58:23.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 44849 5.82 MB/sec execute 295 sec latency 81.470 ms 2024-04-26T21:58:24.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45000 5.83 MB/sec execute 296 sec latency 88.362 ms 2024-04-26T21:58:25.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45072 5.83 MB/sec execute 297 sec latency 434.896 ms 2024-04-26T21:58:26.932 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45223 5.85 MB/sec execute 298 sec latency 124.735 ms 2024-04-26T21:58:27.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45344 5.86 MB/sec execute 299 sec latency 106.893 ms 2024-04-26T21:58:28.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45518 5.90 MB/sec execute 300 sec latency 113.715 ms 2024-04-26T21:58:29.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45670 5.93 MB/sec execute 301 sec latency 135.377 ms 2024-04-26T21:58:30.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45763 5.93 MB/sec execute 302 sec latency 314.024 ms 2024-04-26T21:58:31.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45891 5.93 MB/sec execute 303 sec latency 514.988 ms 2024-04-26T21:58:32.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 45960 5.93 MB/sec execute 304 sec latency 97.400 ms 2024-04-26T21:58:33.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46033 5.93 MB/sec execute 305 sec latency 100.587 ms 2024-04-26T21:58:34.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46120 5.94 MB/sec execute 306 sec latency 102.703 ms 2024-04-26T21:58:35.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46252 5.97 MB/sec execute 307 sec latency 102.685 ms 2024-04-26T21:58:36.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46317 5.96 MB/sec execute 308 sec latency 437.856 ms 2024-04-26T21:58:37.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46413 5.95 MB/sec execute 309 sec latency 169.938 ms 2024-04-26T21:58:38.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46500 5.95 MB/sec execute 310 sec latency 103.090 ms 2024-04-26T21:58:39.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46538 5.93 MB/sec execute 311 sec latency 552.126 ms 2024-04-26T21:58:40.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46619 5.92 MB/sec execute 312 sec latency 131.060 ms 2024-04-26T21:58:41.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46684 5.90 MB/sec execute 313 sec latency 174.428 ms 2024-04-26T21:58:42.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46772 5.88 MB/sec execute 314 sec latency 138.554 ms 2024-04-26T21:58:43.933 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46875 5.87 MB/sec execute 315 sec latency 146.305 ms 2024-04-26T21:58:44.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 46960 5.86 MB/sec execute 316 sec latency 325.378 ms 2024-04-26T21:58:45.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47070 5.85 MB/sec execute 317 sec latency 162.400 ms 2024-04-26T21:58:46.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47143 5.85 MB/sec execute 318 sec latency 467.238 ms 2024-04-26T21:58:47.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47258 5.84 MB/sec execute 319 sec latency 191.917 ms 2024-04-26T21:58:48.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47392 5.86 MB/sec execute 320 sec latency 108.392 ms 2024-04-26T21:58:49.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47493 5.85 MB/sec execute 321 sec latency 285.146 ms 2024-04-26T21:58:50.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47598 5.86 MB/sec execute 322 sec latency 531.892 ms 2024-04-26T21:58:51.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47748 5.88 MB/sec execute 323 sec latency 95.833 ms 2024-04-26T21:58:52.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47863 5.86 MB/sec execute 324 sec latency 96.402 ms 2024-04-26T21:58:53.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 47996 5.85 MB/sec execute 325 sec latency 103.231 ms 2024-04-26T21:58:54.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 48130 5.84 MB/sec execute 326 sec latency 85.743 ms 2024-04-26T21:58:55.934 INFO:tasks.workunit.client.0.smithi005.stdout: 10 48208 5.82 MB/sec execute 327 sec latency 327.253 ms 2024-04-26T21:58:56.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 48336 5.81 MB/sec execute 328 sec latency 123.489 ms 2024-04-26T21:58:57.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 48464 5.82 MB/sec execute 329 sec latency 101.213 ms 2024-04-26T21:58:58.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 48601 5.83 MB/sec execute 330 sec latency 101.984 ms 2024-04-26T21:58:59.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 48735 5.84 MB/sec execute 331 sec latency 119.941 ms 2024-04-26T21:59:00.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 48867 5.85 MB/sec execute 332 sec latency 99.042 ms 2024-04-26T21:59:01.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49027 5.87 MB/sec execute 333 sec latency 100.779 ms 2024-04-26T21:59:02.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49206 5.91 MB/sec execute 334 sec latency 118.976 ms 2024-04-26T21:59:03.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49341 5.92 MB/sec execute 335 sec latency 112.416 ms 2024-04-26T21:59:04.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49471 5.93 MB/sec execute 336 sec latency 130.440 ms 2024-04-26T21:59:05.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49541 5.94 MB/sec execute 337 sec latency 89.644 ms 2024-04-26T21:59:06.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49600 5.93 MB/sec execute 338 sec latency 101.787 ms 2024-04-26T21:59:07.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49680 5.93 MB/sec execute 339 sec latency 109.965 ms 2024-04-26T21:59:08.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49817 5.96 MB/sec execute 340 sec latency 109.062 ms 2024-04-26T21:59:09.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 49922 5.95 MB/sec execute 341 sec latency 97.677 ms 2024-04-26T21:59:10.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50013 5.95 MB/sec execute 342 sec latency 98.349 ms 2024-04-26T21:59:11.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50076 5.94 MB/sec execute 343 sec latency 121.626 ms 2024-04-26T21:59:12.935 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50154 5.92 MB/sec execute 344 sec latency 186.203 ms 2024-04-26T21:59:13.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50232 5.91 MB/sec execute 345 sec latency 128.976 ms 2024-04-26T21:59:14.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50309 5.89 MB/sec execute 346 sec latency 142.084 ms 2024-04-26T21:59:15.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50385 5.88 MB/sec execute 347 sec latency 184.835 ms 2024-04-26T21:59:16.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50475 5.87 MB/sec execute 348 sec latency 215.341 ms 2024-04-26T21:59:17.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50583 5.86 MB/sec execute 349 sec latency 133.430 ms 2024-04-26T21:59:18.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50701 5.86 MB/sec execute 350 sec latency 168.082 ms 2024-04-26T21:59:19.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50805 5.86 MB/sec execute 351 sec latency 259.370 ms 2024-04-26T21:59:20.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 50897 5.86 MB/sec execute 352 sec latency 460.696 ms 2024-04-26T21:59:21.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51015 5.86 MB/sec execute 353 sec latency 109.497 ms 2024-04-26T21:59:22.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51136 5.87 MB/sec execute 354 sec latency 110.952 ms 2024-04-26T21:59:23.936 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51208 5.86 MB/sec execute 355 sec latency 447.790 ms 2024-04-26T21:59:24.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51335 5.87 MB/sec execute 356 sec latency 101.192 ms 2024-04-26T21:59:25.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51411 5.85 MB/sec execute 357 sec latency 393.595 ms 2024-04-26T21:59:26.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51533 5.84 MB/sec execute 358 sec latency 105.247 ms 2024-04-26T21:59:27.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51665 5.83 MB/sec execute 359 sec latency 105.434 ms 2024-04-26T21:59:28.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51758 5.82 MB/sec execute 360 sec latency 260.323 ms 2024-04-26T21:59:29.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 51888 5.81 MB/sec execute 361 sec latency 81.239 ms 2024-04-26T21:59:30.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 52021 5.82 MB/sec execute 362 sec latency 88.157 ms 2024-04-26T21:59:31.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 52161 5.83 MB/sec execute 363 sec latency 105.880 ms 2024-04-26T21:59:32.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 52294 5.84 MB/sec execute 364 sec latency 99.476 ms 2024-04-26T21:59:33.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 52423 5.85 MB/sec execute 365 sec latency 110.961 ms 2024-04-26T21:59:34.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 52583 5.87 MB/sec execute 366 sec latency 98.146 ms 2024-04-26T21:59:35.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 52727 5.90 MB/sec execute 367 sec latency 136.203 ms 2024-04-26T21:59:36.937 INFO:tasks.workunit.client.0.smithi005.stdout: 10 52872 5.91 MB/sec execute 368 sec latency 155.246 ms 2024-04-26T21:59:37.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53011 5.91 MB/sec execute 369 sec latency 121.578 ms 2024-04-26T21:59:38.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53066 5.91 MB/sec execute 370 sec latency 452.739 ms 2024-04-26T21:59:39.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53124 5.91 MB/sec execute 371 sec latency 454.077 ms 2024-04-26T21:59:40.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53192 5.91 MB/sec execute 372 sec latency 130.420 ms 2024-04-26T21:59:41.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53299 5.92 MB/sec execute 373 sec latency 137.133 ms 2024-04-26T21:59:42.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53419 5.93 MB/sec execute 374 sec latency 98.390 ms 2024-04-26T21:59:43.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:59:43.086 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:59:43.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53515 5.93 MB/sec execute 375 sec latency 120.527 ms 2024-04-26T21:59:44.938 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53598 5.92 MB/sec execute 376 sec latency 122.277 ms 2024-04-26T21:59:45.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53665 5.91 MB/sec execute 377 sec latency 166.953 ms 2024-04-26T21:59:46.939 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53724 5.90 MB/sec execute 378 sec latency 176.842 ms 2024-04-26T21:59:47.939 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53786 5.88 MB/sec execute 379 sec latency 222.472 ms 2024-04-26T21:59:48.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53862 5.87 MB/sec execute 380 sec latency 177.462 ms 2024-04-26T21:59:49.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 53950 5.86 MB/sec execute 381 sec latency 135.939 ms 2024-04-26T21:59:50.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54047 5.85 MB/sec execute 382 sec latency 155.198 ms 2024-04-26T21:59:51.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54164 5.85 MB/sec execute 383 sec latency 141.246 ms 2024-04-26T21:59:52.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54264 5.84 MB/sec execute 384 sec latency 136.549 ms 2024-04-26T21:59:53.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54396 5.85 MB/sec execute 385 sec latency 137.603 ms 2024-04-26T21:59:54.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54526 5.86 MB/sec execute 386 sec latency 91.900 ms 2024-04-26T21:59:55.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54635 5.84 MB/sec execute 387 sec latency 99.466 ms 2024-04-26T21:59:56.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54773 5.85 MB/sec execute 388 sec latency 117.003 ms 2024-04-26T21:59:57.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54907 5.86 MB/sec execute 389 sec latency 91.800 ms 2024-04-26T21:59:58.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 54984 5.85 MB/sec execute 390 sec latency 425.358 ms 2024-04-26T21:59:59.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55106 5.84 MB/sec execute 391 sec latency 102.969 ms 2024-04-26T22:00:00.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55237 5.83 MB/sec execute 392 sec latency 128.242 ms 2024-04-26T22:00:01.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55360 5.82 MB/sec execute 393 sec latency 85.944 ms 2024-04-26T22:00:02.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55489 5.82 MB/sec execute 394 sec latency 85.167 ms 2024-04-26T22:00:03.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55569 5.82 MB/sec execute 395 sec latency 472.890 ms 2024-04-26T22:00:04.940 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55701 5.82 MB/sec execute 396 sec latency 178.812 ms 2024-04-26T22:00:05.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55830 5.83 MB/sec execute 397 sec latency 139.116 ms 2024-04-26T22:00:06.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 55944 5.84 MB/sec execute 398 sec latency 117.060 ms 2024-04-26T22:00:07.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56102 5.86 MB/sec execute 399 sec latency 128.367 ms 2024-04-26T22:00:08.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56265 5.89 MB/sec execute 400 sec latency 111.214 ms 2024-04-26T22:00:09.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56407 5.90 MB/sec execute 401 sec latency 149.418 ms 2024-04-26T22:00:10.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56546 5.90 MB/sec execute 402 sec latency 137.894 ms 2024-04-26T22:00:11.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56622 5.91 MB/sec execute 403 sec latency 106.738 ms 2024-04-26T22:00:12.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56693 5.91 MB/sec execute 404 sec latency 101.191 ms 2024-04-26T22:00:13.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:13.216 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:13.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56722 5.90 MB/sec execute 405 sec latency 472.777 ms 2024-04-26T22:00:14.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56756 5.88 MB/sec execute 406 sec latency 565.496 ms 2024-04-26T22:00:15.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56843 5.89 MB/sec execute 407 sec latency 156.205 ms 2024-04-26T22:00:16.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 56969 5.91 MB/sec execute 408 sec latency 136.065 ms 2024-04-26T22:00:17.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57073 5.90 MB/sec execute 409 sec latency 98.546 ms 2024-04-26T22:00:18.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57155 5.90 MB/sec execute 410 sec latency 128.545 ms 2024-04-26T22:00:19.941 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57204 5.88 MB/sec execute 411 sec latency 341.766 ms 2024-04-26T22:00:20.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57273 5.87 MB/sec execute 412 sec latency 170.157 ms 2024-04-26T22:00:21.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57351 5.86 MB/sec execute 413 sec latency 118.625 ms 2024-04-26T22:00:22.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57433 5.85 MB/sec execute 414 sec latency 169.632 ms 2024-04-26T22:00:23.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57522 5.84 MB/sec execute 415 sec latency 170.959 ms 2024-04-26T22:00:24.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57611 5.83 MB/sec execute 416 sec latency 169.578 ms 2024-04-26T22:00:25.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57719 5.83 MB/sec execute 417 sec latency 142.375 ms 2024-04-26T22:00:26.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57827 5.82 MB/sec execute 418 sec latency 161.435 ms 2024-04-26T22:00:27.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 57957 5.83 MB/sec execute 419 sec latency 79.046 ms 2024-04-26T22:00:28.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58085 5.84 MB/sec execute 420 sec latency 105.474 ms 2024-04-26T22:00:29.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58145 5.83 MB/sec execute 421 sec latency 541.721 ms 2024-04-26T22:00:30.942 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58261 5.83 MB/sec execute 422 sec latency 124.527 ms 2024-04-26T22:00:31.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58402 5.84 MB/sec execute 423 sec latency 132.079 ms 2024-04-26T22:00:32.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58528 5.83 MB/sec execute 424 sec latency 100.170 ms 2024-04-26T22:00:33.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58651 5.82 MB/sec execute 425 sec latency 100.976 ms 2024-04-26T22:00:34.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58785 5.81 MB/sec execute 426 sec latency 103.581 ms 2024-04-26T22:00:35.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 58914 5.81 MB/sec execute 427 sec latency 84.422 ms 2024-04-26T22:00:36.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59036 5.81 MB/sec execute 428 sec latency 106.130 ms 2024-04-26T22:00:37.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59172 5.81 MB/sec execute 429 sec latency 90.574 ms 2024-04-26T22:00:38.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59304 5.82 MB/sec execute 430 sec latency 114.353 ms 2024-04-26T22:00:39.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59420 5.83 MB/sec execute 431 sec latency 128.167 ms 2024-04-26T22:00:40.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59574 5.83 MB/sec execute 432 sec latency 118.994 ms 2024-04-26T22:00:41.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59699 5.86 MB/sec execute 433 sec latency 115.121 ms 2024-04-26T22:00:42.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59856 5.87 MB/sec execute 434 sec latency 113.234 ms 2024-04-26T22:00:43.943 INFO:tasks.workunit.client.0.smithi005.stdout: 10 59982 5.88 MB/sec execute 435 sec latency 104.868 ms 2024-04-26T22:00:44.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:44.652 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:44.738 INFO:tasks.ceph.mds.b.smithi112.stderr:2024-04-26T22:00:44.738+0000 7fc6f2c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39160) UID: 0 2024-04-26T22:00:44.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60120 5.89 MB/sec execute 436 sec latency 173.538 ms 2024-04-26T22:00:45.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60189 5.89 MB/sec execute 437 sec latency 134.577 ms 2024-04-26T22:00:46.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60258 5.89 MB/sec execute 438 sec latency 111.186 ms 2024-04-26T22:00:47.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60318 5.88 MB/sec execute 439 sec latency 99.761 ms 2024-04-26T22:00:48.946 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60390 5.88 MB/sec execute 440 sec latency 462.600 ms 2024-04-26T22:00:49.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60515 5.90 MB/sec execute 441 sec latency 147.630 ms 2024-04-26T22:00:50.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60614 5.89 MB/sec execute 442 sec latency 120.979 ms 2024-04-26T22:00:51.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60707 5.89 MB/sec execute 443 sec latency 89.474 ms 2024-04-26T22:00:52.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60780 5.88 MB/sec execute 444 sec latency 169.512 ms 2024-04-26T22:00:53.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60848 5.87 MB/sec execute 445 sec latency 164.153 ms 2024-04-26T22:00:54.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 60937 5.86 MB/sec execute 446 sec latency 120.584 ms 2024-04-26T22:00:55.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61022 5.85 MB/sec execute 447 sec latency 113.217 ms 2024-04-26T22:00:56.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61118 5.84 MB/sec execute 448 sec latency 206.061 ms 2024-04-26T22:00:57.944 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61227 5.84 MB/sec execute 449 sec latency 140.943 ms 2024-04-26T22:00:58.945 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61341 5.83 MB/sec execute 450 sec latency 155.093 ms 2024-04-26T22:00:59.945 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61472 5.84 MB/sec execute 451 sec latency 109.452 ms 2024-04-26T22:01:00.945 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61591 5.84 MB/sec execute 452 sec latency 94.144 ms 2024-04-26T22:01:01.945 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61695 5.84 MB/sec execute 453 sec latency 109.404 ms 2024-04-26T22:01:02.945 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61823 5.84 MB/sec execute 454 sec latency 126.295 ms 2024-04-26T22:01:03.945 INFO:tasks.workunit.client.0.smithi005.stdout: 10 61961 5.85 MB/sec execute 455 sec latency 100.307 ms 2024-04-26T22:01:04.945 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62053 5.84 MB/sec execute 456 sec latency 330.355 ms 2024-04-26T22:01:05.946 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62178 5.83 MB/sec execute 457 sec latency 102.024 ms 2024-04-26T22:01:06.946 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62304 5.83 MB/sec execute 458 sec latency 94.409 ms 2024-04-26T22:01:07.946 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62433 5.82 MB/sec execute 459 sec latency 79.846 ms 2024-04-26T22:01:08.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62570 5.82 MB/sec execute 460 sec latency 91.903 ms 2024-04-26T22:01:09.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62694 5.82 MB/sec execute 461 sec latency 123.610 ms 2024-04-26T22:01:10.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62841 5.83 MB/sec execute 462 sec latency 104.214 ms 2024-04-26T22:01:11.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 62952 5.83 MB/sec execute 463 sec latency 112.692 ms 2024-04-26T22:01:12.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63049 5.83 MB/sec execute 464 sec latency 231.225 ms 2024-04-26T22:01:13.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63194 5.85 MB/sec execute 465 sec latency 106.626 ms 2024-04-26T22:01:14.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63334 5.87 MB/sec execute 466 sec latency 132.675 ms 2024-04-26T22:01:15.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63495 5.88 MB/sec execute 467 sec latency 111.848 ms 2024-04-26T22:01:16.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63628 5.88 MB/sec execute 468 sec latency 166.351 ms 2024-04-26T22:01:17.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63733 5.90 MB/sec execute 469 sec latency 98.356 ms 2024-04-26T22:01:18.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63789 5.89 MB/sec execute 470 sec latency 98.067 ms 2024-04-26T22:01:19.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63833 5.88 MB/sec execute 471 sec latency 435.086 ms 2024-04-26T22:01:20.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63886 5.88 MB/sec execute 472 sec latency 486.488 ms 2024-04-26T22:01:21.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 63982 5.88 MB/sec execute 473 sec latency 95.196 ms 2024-04-26T22:01:22.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64107 5.90 MB/sec execute 474 sec latency 101.036 ms 2024-04-26T22:01:23.947 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64199 5.89 MB/sec execute 475 sec latency 113.596 ms 2024-04-26T22:01:24.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64266 5.88 MB/sec execute 476 sec latency 293.792 ms 2024-04-26T22:01:25.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64331 5.87 MB/sec execute 477 sec latency 458.221 ms 2024-04-26T22:01:26.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64406 5.86 MB/sec execute 478 sec latency 185.795 ms 2024-04-26T22:01:27.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64484 5.86 MB/sec execute 479 sec latency 128.903 ms 2024-04-26T22:01:28.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64571 5.85 MB/sec execute 480 sec latency 116.709 ms 2024-04-26T22:01:29.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64671 5.84 MB/sec execute 481 sec latency 157.705 ms 2024-04-26T22:01:30.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64730 5.83 MB/sec execute 482 sec latency 545.818 ms 2024-04-26T22:01:31.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64820 5.83 MB/sec execute 483 sec latency 171.957 ms 2024-04-26T22:01:32.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 64933 5.83 MB/sec execute 484 sec latency 171.569 ms 2024-04-26T22:01:33.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65059 5.83 MB/sec execute 485 sec latency 102.412 ms 2024-04-26T22:01:34.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65189 5.83 MB/sec execute 486 sec latency 97.653 ms 2024-04-26T22:01:35.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65323 5.83 MB/sec execute 487 sec latency 99.379 ms 2024-04-26T22:01:36.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65447 5.84 MB/sec execute 488 sec latency 127.363 ms 2024-04-26T22:01:37.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65578 5.84 MB/sec execute 489 sec latency 98.825 ms 2024-04-26T22:01:38.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65690 5.83 MB/sec execute 490 sec latency 99.017 ms 2024-04-26T22:01:39.948 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65819 5.82 MB/sec execute 491 sec latency 102.641 ms 2024-04-26T22:01:40.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 65897 5.81 MB/sec execute 492 sec latency 476.946 ms 2024-04-26T22:01:41.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 66013 5.81 MB/sec execute 493 sec latency 100.841 ms 2024-04-26T22:01:42.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 66161 5.81 MB/sec execute 494 sec latency 96.187 ms 2024-04-26T22:01:43.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 66304 5.81 MB/sec execute 495 sec latency 90.652 ms 2024-04-26T22:01:44.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 66433 5.82 MB/sec execute 496 sec latency 121.693 ms 2024-04-26T22:01:45.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 66536 5.82 MB/sec execute 497 sec latency 122.894 ms 2024-04-26T22:01:46.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 66665 5.83 MB/sec execute 498 sec latency 113.965 ms 2024-04-26T22:01:47.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 66826 5.85 MB/sec execute 499 sec latency 77.811 ms 2024-04-26T22:01:48.949 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67024 5.87 MB/sec execute 500 sec latency 106.990 ms 2024-04-26T22:01:49.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67157 5.88 MB/sec execute 501 sec latency 127.479 ms 2024-04-26T22:01:50.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67278 5.89 MB/sec execute 502 sec latency 115.425 ms 2024-04-26T22:01:51.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67334 5.88 MB/sec execute 503 sec latency 89.970 ms 2024-04-26T22:01:52.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67395 5.88 MB/sec execute 504 sec latency 98.036 ms 2024-04-26T22:01:53.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67482 5.88 MB/sec execute 505 sec latency 122.263 ms 2024-04-26T22:01:54.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67614 5.90 MB/sec execute 506 sec latency 117.075 ms 2024-04-26T22:01:55.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67709 5.89 MB/sec execute 507 sec latency 114.242 ms 2024-04-26T22:01:56.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67803 5.89 MB/sec execute 508 sec latency 126.208 ms 2024-04-26T22:01:57.950 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67883 5.88 MB/sec execute 509 sec latency 123.944 ms 2024-04-26T22:01:58.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 67962 5.87 MB/sec execute 510 sec latency 103.998 ms 2024-04-26T22:01:59.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68046 5.86 MB/sec execute 511 sec latency 145.130 ms 2024-04-26T22:02:00.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68091 5.85 MB/sec execute 512 sec latency 461.636 ms 2024-04-26T22:02:01.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68167 5.85 MB/sec execute 513 sec latency 141.364 ms 2024-04-26T22:02:02.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68272 5.84 MB/sec execute 514 sec latency 157.357 ms 2024-04-26T22:02:03.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68384 5.84 MB/sec execute 515 sec latency 126.177 ms 2024-04-26T22:02:04.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68497 5.84 MB/sec execute 516 sec latency 101.174 ms 2024-04-26T22:02:05.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68610 5.84 MB/sec execute 517 sec latency 194.096 ms 2024-04-26T22:02:06.951 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68726 5.84 MB/sec execute 518 sec latency 99.082 ms 2024-04-26T22:02:07.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68852 5.84 MB/sec execute 519 sec latency 103.991 ms 2024-04-26T22:02:08.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 68979 5.84 MB/sec execute 520 sec latency 98.913 ms 2024-04-26T22:02:09.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69117 5.85 MB/sec execute 521 sec latency 108.075 ms 2024-04-26T22:02:10.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69237 5.84 MB/sec execute 522 sec latency 84.943 ms 2024-04-26T22:02:11.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69365 5.83 MB/sec execute 523 sec latency 115.678 ms 2024-04-26T22:02:12.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69494 5.83 MB/sec execute 524 sec latency 97.846 ms 2024-04-26T22:02:13.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69621 5.82 MB/sec execute 525 sec latency 113.165 ms 2024-04-26T22:02:14.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69752 5.82 MB/sec execute 526 sec latency 104.107 ms 2024-04-26T22:02:15.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69891 5.83 MB/sec execute 527 sec latency 232.042 ms 2024-04-26T22:02:16.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 69969 5.83 MB/sec execute 528 sec latency 529.381 ms 2024-04-26T22:02:17.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70074 5.83 MB/sec execute 529 sec latency 103.796 ms 2024-04-26T22:02:18.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70186 5.83 MB/sec execute 530 sec latency 121.161 ms 2024-04-26T22:02:19.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70314 5.84 MB/sec execute 531 sec latency 157.336 ms 2024-04-26T22:02:20.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70480 5.87 MB/sec execute 532 sec latency 108.981 ms 2024-04-26T22:02:21.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70572 5.87 MB/sec execute 533 sec latency 515.395 ms 2024-04-26T22:02:22.952 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70724 5.88 MB/sec execute 534 sec latency 123.718 ms 2024-04-26T22:02:23.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70823 5.88 MB/sec execute 535 sec latency 121.267 ms 2024-04-26T22:02:24.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70874 5.88 MB/sec execute 536 sec latency 98.074 ms 2024-04-26T22:02:25.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70940 5.87 MB/sec execute 537 sec latency 85.083 ms 2024-04-26T22:02:26.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 70991 5.87 MB/sec execute 538 sec latency 455.771 ms 2024-04-26T22:02:27.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71112 5.88 MB/sec execute 539 sec latency 553.751 ms 2024-04-26T22:02:28.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71224 5.88 MB/sec execute 540 sec latency 119.248 ms 2024-04-26T22:02:29.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71319 5.88 MB/sec execute 541 sec latency 157.270 ms 2024-04-26T22:02:30.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71397 5.87 MB/sec execute 542 sec latency 121.715 ms 2024-04-26T22:02:31.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71462 5.87 MB/sec execute 543 sec latency 158.409 ms 2024-04-26T22:02:32.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71538 5.86 MB/sec execute 544 sec latency 232.899 ms 2024-04-26T22:02:33.953 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71620 5.85 MB/sec execute 545 sec latency 141.763 ms 2024-04-26T22:02:34.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71723 5.84 MB/sec execute 546 sec latency 139.178 ms 2024-04-26T22:02:35.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71803 5.84 MB/sec execute 547 sec latency 313.404 ms 2024-04-26T22:02:36.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 71898 5.83 MB/sec execute 548 sec latency 497.780 ms 2024-04-26T22:02:37.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72005 5.83 MB/sec execute 549 sec latency 209.106 ms 2024-04-26T22:02:38.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72117 5.83 MB/sec execute 550 sec latency 131.775 ms 2024-04-26T22:02:39.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72239 5.83 MB/sec execute 551 sec latency 111.018 ms 2024-04-26T22:02:40.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72363 5.83 MB/sec execute 552 sec latency 96.739 ms 2024-04-26T22:02:41.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72499 5.84 MB/sec execute 553 sec latency 105.119 ms 2024-04-26T22:02:42.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72594 5.84 MB/sec execute 554 sec latency 428.103 ms 2024-04-26T22:02:43.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72718 5.84 MB/sec execute 555 sec latency 95.467 ms 2024-04-26T22:02:44.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72837 5.83 MB/sec execute 556 sec latency 93.515 ms 2024-04-26T22:02:45.954 INFO:tasks.workunit.client.0.smithi005.stdout: 10 72970 5.82 MB/sec execute 557 sec latency 123.203 ms 2024-04-26T22:02:46.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73087 5.82 MB/sec execute 558 sec latency 117.493 ms 2024-04-26T22:02:47.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73238 5.82 MB/sec execute 559 sec latency 100.550 ms 2024-04-26T22:02:48.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73364 5.81 MB/sec execute 560 sec latency 99.186 ms 2024-04-26T22:02:49.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73525 5.83 MB/sec execute 561 sec latency 93.503 ms 2024-04-26T22:02:50.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73636 5.83 MB/sec execute 562 sec latency 106.932 ms 2024-04-26T22:02:51.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73701 5.82 MB/sec execute 563 sec latency 410.653 ms 2024-04-26T22:02:52.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73830 5.83 MB/sec execute 564 sec latency 140.847 ms 2024-04-26T22:02:53.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 73942 5.84 MB/sec execute 565 sec latency 152.022 ms 2024-04-26T22:02:54.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74126 5.86 MB/sec execute 566 sec latency 130.614 ms 2024-04-26T22:02:55.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74281 5.87 MB/sec execute 567 sec latency 93.614 ms 2024-04-26T22:02:56.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74406 5.88 MB/sec execute 568 sec latency 94.084 ms 2024-04-26T22:02:57.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74452 5.87 MB/sec execute 569 sec latency 107.385 ms 2024-04-26T22:02:58.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74514 5.87 MB/sec execute 570 sec latency 119.375 ms 2024-04-26T22:02:59.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74606 5.87 MB/sec execute 571 sec latency 89.421 ms 2024-04-26T22:03:00.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74739 5.89 MB/sec execute 572 sec latency 122.024 ms 2024-04-26T22:03:01.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74843 5.88 MB/sec execute 573 sec latency 151.214 ms 2024-04-26T22:03:02.955 INFO:tasks.workunit.client.0.smithi005.stdout: 10 74922 5.88 MB/sec execute 574 sec latency 159.645 ms 2024-04-26T22:03:03.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75007 5.87 MB/sec execute 575 sec latency 124.026 ms 2024-04-26T22:03:04.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75087 5.87 MB/sec execute 576 sec latency 123.526 ms 2024-04-26T22:03:05.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75168 5.86 MB/sec execute 577 sec latency 168.498 ms 2024-04-26T22:03:06.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75249 5.85 MB/sec execute 578 sec latency 173.274 ms 2024-04-26T22:03:07.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75355 5.85 MB/sec execute 579 sec latency 202.984 ms 2024-04-26T22:03:08.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75454 5.84 MB/sec execute 580 sec latency 191.296 ms 2024-04-26T22:03:09.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75558 5.84 MB/sec execute 581 sec latency 150.663 ms 2024-04-26T22:03:10.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75674 5.84 MB/sec execute 582 sec latency 166.699 ms 2024-04-26T22:03:11.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75790 5.84 MB/sec execute 583 sec latency 156.213 ms 2024-04-26T22:03:12.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 75914 5.84 MB/sec execute 584 sec latency 101.432 ms 2024-04-26T22:03:13.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76034 5.83 MB/sec execute 585 sec latency 100.683 ms 2024-04-26T22:03:14.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76162 5.85 MB/sec execute 586 sec latency 133.656 ms 2024-04-26T22:03:15.956 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76243 5.84 MB/sec execute 587 sec latency 507.435 ms 2024-04-26T22:03:16.957 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76317 5.83 MB/sec execute 588 sec latency 507.693 ms 2024-04-26T22:03:17.957 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76435 5.83 MB/sec execute 589 sec latency 91.570 ms 2024-04-26T22:03:18.957 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76567 5.82 MB/sec execute 590 sec latency 103.541 ms 2024-04-26T22:03:19.957 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76680 5.82 MB/sec execute 591 sec latency 90.359 ms 2024-04-26T22:03:20.957 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76795 5.82 MB/sec execute 592 sec latency 310.319 ms 2024-04-26T22:03:21.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 76929 5.82 MB/sec execute 593 sec latency 110.915 ms 2024-04-26T22:03:22.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 77077 5.83 MB/sec execute 594 sec latency 112.817 ms 2024-04-26T22:03:23.959 INFO:tasks.workunit.client.0.smithi005.stdout: 10 77201 5.83 MB/sec execute 595 sec latency 104.018 ms 2024-04-26T22:03:24.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 77303 5.83 MB/sec execute 596 sec latency 103.614 ms 2024-04-26T22:03:25.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 77430 5.84 MB/sec execute 597 sec latency 123.757 ms 2024-04-26T22:03:26.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 77553 5.85 MB/sec execute 598 sec latency 243.032 ms 2024-04-26T22:03:27.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 77715 5.86 MB/sec execute 599 sec latency 149.656 ms 2024-04-26T22:03:28.958 INFO:tasks.workunit.client.0.smithi005.stdout: 10 cleanup 600 sec 2024-04-26T22:03:29.959 INFO:tasks.workunit.client.0.smithi005.stdout: 10 cleanup 601 sec 2024-04-26T22:03:30.959 INFO:tasks.workunit.client.0.smithi005.stdout: 10 cleanup 602 sec 2024-04-26T22:03:31.959 INFO:tasks.workunit.client.0.smithi005.stdout: 10 cleanup 603 sec 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: 0 cleanup 604 sec 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: Operation Count AvgLat MaxLat 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: ---------------------------------------- 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: NTCreateX 111603 14.894 745.327 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: Close 82028 0.249 9.124 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: Rename 4788 36.463 504.872 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: Unlink 22529 12.029 434.859 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: Qpathinfo 101234 8.234 481.540 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: Qfileinfo 17827 0.528 321.058 2024-04-26T22:03:32.862 INFO:tasks.workunit.client.0.smithi005.stdout: Qfsinfo 18682 1.320 275.241 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: Sfileinfo 9147 3.711 314.712 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: Find 39270 71.410 830.419 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: WriteX 55477 0.918 307.998 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: ReadX 177704 0.010 5.110 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: LockX 380 3.751 54.504 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: UnlockX 380 2.967 10.149 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: Flush 7840 13.690 394.112 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-04-26T22:03:32.863 INFO:tasks.workunit.client.0.smithi005.stdout:Throughput 5.86451 MB/sec 10 clients 10 procs max_latency=830.427 ms 2024-04-26T22:03:32.876 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T22:03:32.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T22:03:35.441 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-04-26T22:03:35.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T22:03:36.371 DEBUG:teuthology.parallel:result is None 2024-04-26T22:03:36.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T22:03:36.479 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T22:03:36.479 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T22:03:36.489 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T22:03:36.489 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T22:03:36.489 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:36.566 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T22:03:36.566 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:36.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:03:37.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.359+0000 7f998da00640 1 Processor -- start 2024-04-26T22:03:37.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.359+0000 7f998da00640 1 -- start start 2024-04-26T22:03:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f998da00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99880b6e40 0x7f9988145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f998da00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99880b7220 con 0x7f99880b0be0 2024-04-26T22:03:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f998da00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99881454f0 con 0x7f9988149060 2024-04-26T22:03:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f998da00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9988145860 con 0x7f99880b6e40 2024-04-26T22:03:37.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f9986a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99880b6e40 0x7f9988145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f9986a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99880b6e40 0x7f9988145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60738/0 (socket says 172.21.15.5:60738) 2024-04-26T22:03:37.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f9986a00640 1 -- 172.21.15.5:0/1133422707 learned_addr learned my addr 172.21.15.5:0/1133422707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:37.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.361+0000 7f9986000640 1 --1- 172.21.15.5:0/1133422707 >> v1:172.21.15.5:6789/0 conn(0x7f99880b0be0 0x7f9988148950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46916/0 (socket says 172.21.15.5:46916) 2024-04-26T22:03:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.362+0000 7f9986a00640 1 -- 172.21.15.5:0/1133422707 >> v1:172.21.15.112:6789/0 conn(0x7f9988149060 legacy=0x7f998814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.362+0000 7f9986a00640 1 -- 172.21.15.5:0/1133422707 >> v1:172.21.15.5:6789/0 conn(0x7f99880b0be0 legacy=0x7f9988148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.362+0000 7f9986a00640 1 -- 172.21.15.5:0/1133422707 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99880b30e0 con 0x7f99880b6e40 2024-04-26T22:03:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.363+0000 7f9986a00640 1 --2- 172.21.15.5:0/1133422707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6e40 0x7f9988145cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f997800d150 tx=0x7f997802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64be9b2aa881495e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.363+0000 7f9985600640 1 -- 172.21.15.5:0/1133422707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800b2e0 con 0x7f99880b6e40 2024-04-26T22:03:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.363+0000 7f9985600640 1 -- 172.21.15.5:0/1133422707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9978009600 con 0x7f99880b6e40 2024-04-26T22:03:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.363+0000 7f9985600640 1 -- 172.21.15.5:0/1133422707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800b480 con 0x7f99880b6e40 2024-04-26T22:03:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.364+0000 7f998da00640 1 -- 172.21.15.5:0/1133422707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6e40 msgr2=0x7f9988145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.364+0000 7f998da00640 1 --2- 172.21.15.5:0/1133422707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6e40 0x7f9988145cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f997800d150 tx=0x7f997802c8e0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.364+0000 7f998da00640 1 -- 172.21.15.5:0/1133422707 shutdown_connections 2024-04-26T22:03:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.364+0000 7f998da00640 1 --2- 172.21.15.5:0/1133422707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b6e40 0x7f9988145cf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.364+0000 7f998da00640 1 -- 172.21.15.5:0/1133422707 >> 172.21.15.5:0/1133422707 conn(0x7f998806c720 msgr2=0x7f998806cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.364+0000 7f998da00640 1 -- 172.21.15.5:0/1133422707 shutdown_connections 2024-04-26T22:03:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.364+0000 7f998da00640 1 -- 172.21.15.5:0/1133422707 wait complete. 2024-04-26T22:03:37.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.366+0000 7f998da00640 1 Processor -- start 2024-04-26T22:03:37.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.367+0000 7f998da00640 1 -- start start 2024-04-26T22:03:37.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.367+0000 7f998da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b0be0 0x7f9988073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.367+0000 7f998da00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99880b6e40 0x7f99880ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f998da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9988149060 0x7f9988072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f998da00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99880b37f0 con 0x7f99880b0be0 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f998da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99880b6040 con 0x7f9988149060 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f998da00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f99880b3970 con 0x7f99880b6e40 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b0be0 0x7f9988073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b0be0 0x7f9988073df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60748/0 (socket says 172.21.15.5:60748) 2024-04-26T22:03:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 -- 172.21.15.5:0/2517430257 learned_addr learned my addr 172.21.15.5:0/2517430257 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:37.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9987400640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9988149060 0x7f9988072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 -- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99880b6e40 msgr2=0x7f99880ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986000640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99880b6e40 0x7f99880ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99880b6e40 0x7f99880ba470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 -- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9988149060 msgr2=0x7f9988072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9988149060 0x7f9988072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9986a00640 1 -- 172.21.15.5:0/2517430257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9988073310 con 0x7f99880b0be0 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.368+0000 7f9987400640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9988149060 0x7f9988072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.369+0000 7f9986a00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b0be0 0x7f9988073df0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f997800d270 tx=0x7f9978004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.369+0000 7f997ea00640 1 -- 172.21.15.5:0/2517430257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978042070 con 0x7f99880b0be0 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.369+0000 7f997ea00640 1 -- 172.21.15.5:0/2517430257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997803c860 con 0x7f99880b0be0 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.369+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9988071590 con 0x7f99880b0be0 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.369+0000 7f997ea00640 1 -- 172.21.15.5:0/2517430257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997803cc50 con 0x7f99880b0be0 2024-04-26T22:03:37.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.369+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99880b9640 con 0x7f99880b0be0 2024-04-26T22:03:37.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.371+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9988075db0 con 0x7f99880b0be0 2024-04-26T22:03:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.372+0000 7f997ea00640 1 -- 172.21.15.5:0/2517430257 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9978045070 con 0x7f99880b0be0 2024-04-26T22:03:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.373+0000 7f997ea00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f996806c8f0 0x7f996806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.373+0000 7f997ea00640 1 -- 172.21.15.5:0/2517430257 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9978030020 con 0x7f99880b0be0 2024-04-26T22:03:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.374+0000 7f9986000640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f996806c8f0 0x7f996806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.375+0000 7f9986000640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f996806c8f0 0x7f996806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99881dee90 tx=0x7f9974009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:37.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.378+0000 7f997ea00640 1 -- 172.21.15.5:0/2517430257 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f997804c030 con 0x7f99880b0be0 2024-04-26T22:03:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.589+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99880b5740 con 0x7f99880b0be0 2024-04-26T22:03:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.592+0000 7f997ea00640 1 -- 172.21.15.5:0/2517430257 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18776 (secure 0 0 0) 0x7f997807af70 con 0x7f99880b0be0 2024-04-26T22:03:37.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:03:37.593 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:58.718657+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.594+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f996806c8f0 msgr2=0x7f996806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.594+0000 7f998da00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f996806c8f0 0x7f996806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99881dee90 tx=0x7f9974009040 comp rx=0 tx=0).stop 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.594+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b0be0 msgr2=0x7f9988073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b0be0 0x7f9988073df0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f997800d270 tx=0x7f9978004a40 comp rx=0 tx=0).stop 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 shutdown_connections 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9988149060 0x7f9988072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99880b6e40 0x7f99880ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f996806c8f0 0x7f996806edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 --2- 172.21.15.5:0/2517430257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99880b0be0 0x7f9988073df0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 >> 172.21.15.5:0/2517430257 conn(0x7f998806c720 msgr2=0x7f9988144370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 shutdown_connections 2024-04-26T22:03:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.595+0000 7f998da00640 1 -- 172.21.15.5:0/2517430257 wait complete. 2024-04-26T22:03:37.617 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:37:14.651248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:37:15.859697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:37:19.462053+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T22:03:37.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:03:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.828+0000 7fc8f5c00640 1 Processor -- start 2024-04-26T22:03:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.828+0000 7fc8f5c00640 1 -- start start 2024-04-26T22:03:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.829+0000 7fc8f5c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f00b6d50 0x7fc8f0146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.829+0000 7fc8f5c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc8f01469c0 0x7fc8f00735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.829+0000 7fc8f5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f0073b30 0x7fc8f01499a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.829+0000 7fc8f5c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f0070c20 con 0x7fc8f0073b30 2024-04-26T22:03:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.829+0000 7fc8f5c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f00b3bb0 con 0x7fc8f01469c0 2024-04-26T22:03:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.829+0000 7fc8f5c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f00b6260 con 0x7fc8f00b6d50 2024-04-26T22:03:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f0073b30 0x7fc8f01499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8f0073b30 0x7fc8f01499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60762/0 (socket says 172.21.15.5:60762) 2024-04-26T22:03:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 -- 172.21.15.5:0/2543307746 learned_addr learned my addr 172.21.15.5:0/2543307746 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8e7e00640 1 --2- 172.21.15.5:0/2543307746 >> v2:172.21.15.112:3300/0 conn(0x7fc8f01469c0 0x7fc8f00735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8efe00640 1 --2- 172.21.15.5:0/2543307746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f00b6d50 0x7fc8f0146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 -- 172.21.15.5:0/2543307746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f00b6d50 msgr2=0x7fc8f0146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 --2- 172.21.15.5:0/2543307746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f00b6d50 0x7fc8f0146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 -- 172.21.15.5:0/2543307746 >> v2:172.21.15.112:3300/0 conn(0x7fc8f01469c0 msgr2=0x7fc8f00735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 --2- 172.21.15.5:0/2543307746 >> v2:172.21.15.112:3300/0 conn(0x7fc8f01469c0 0x7fc8f00735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8f5200640 1 -- 172.21.15.5:0/2543307746 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f00b7130 con 0x7fc8f0073b30 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8e7e00640 1 --2- 172.21.15.5:0/2543307746 >> v2:172.21.15.112:3300/0 conn(0x7fc8f01469c0 0x7fc8f00735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.830+0000 7fc8efe00640 1 --2- 172.21.15.5:0/2543307746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f00b6d50 0x7fc8f0146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.831+0000 7fc8f5200640 1 --2- 172.21.15.5:0/2543307746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f01499a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc8f006ecd0 tx=0x7fc8e802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb2c0eeae688fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8ef400640 1 -- 172.21.15.5:0/2543307746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8036070 con 0x7fc8f0073b30 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8ef400640 1 -- 172.21.15.5:0/2543307746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e8031600 con 0x7fc8f0073b30 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8ef400640 1 -- 172.21.15.5:0/2543307746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80319d0 con 0x7fc8f0073b30 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 -- 172.21.15.5:0/2543307746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 msgr2=0x7fc8f01499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/2543307746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f01499a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc8f006ecd0 tx=0x7fc8e802a570 comp rx=0 tx=0).stop 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 -- 172.21.15.5:0/2543307746 shutdown_connections 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/2543307746 >> v2:172.21.15.112:3300/0 conn(0x7fc8f01469c0 0x7fc8f00735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/2543307746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f01499a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/2543307746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f00b6d50 0x7fc8f0146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 -- 172.21.15.5:0/2543307746 >> 172.21.15.5:0/2543307746 conn(0x7fc8f006c720 msgr2=0x7fc8f006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:37.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 -- 172.21.15.5:0/2543307746 shutdown_connections 2024-04-26T22:03:37.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.832+0000 7fc8f5c00640 1 -- 172.21.15.5:0/2543307746 wait complete. 2024-04-26T22:03:37.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.834+0000 7fc8f5c00640 1 Processor -- start 2024-04-26T22:03:37.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.834+0000 7fc8f5c00640 1 -- start start 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8f5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f00b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8f5c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f00b6d50 0x7fc8f013e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8f5c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f01469c0 0x7fc8f01ddb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8f5c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f0073f60 con 0x7fc8f0073b30 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8f5c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f0070700 con 0x7fc8f00b6d50 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8f5c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f00b5c40 con 0x7fc8f01469c0 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f00b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f00b9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60776/0 (socket says 172.21.15.5:60776) 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8efe00640 1 -- 172.21.15.5:0/994828404 learned_addr learned my addr 172.21.15.5:0/994828404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.835+0000 7fc8e7e00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f00b6d50 0x7fc8f013e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.836+0000 7fc8f5200640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f01469c0 0x7fc8f01ddb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.836+0000 7fc8efe00640 1 -- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f01469c0 msgr2=0x7fc8f01ddb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.836+0000 7fc8efe00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f01469c0 0x7fc8f01ddb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.836+0000 7fc8efe00640 1 -- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f00b6d50 msgr2=0x7fc8f013e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.836+0000 7fc8efe00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f00b6d50 0x7fc8f013e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.836+0000 7fc8efe00640 1 -- 172.21.15.5:0/994828404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f01cd7a0 con 0x7fc8f0073b30 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.836+0000 7fc8efe00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f00b9eb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c7c0 tx=0x7fc8e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.837+0000 7fc8ecc00640 1 -- 172.21.15.5:0/994828404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0015070 con 0x7fc8f0073b30 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.837+0000 7fc8ecc00640 1 -- 172.21.15.5:0/994828404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0007a30 con 0x7fc8f0073b30 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.837+0000 7fc8ecc00640 1 -- 172.21.15.5:0/994828404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0007e00 con 0x7fc8f0073b30 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.837+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f0142e50 con 0x7fc8f0073b30 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.837+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f00ba990 con 0x7fc8f0073b30 2024-04-26T22:03:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.838+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f0075db0 con 0x7fc8f0073b30 2024-04-26T22:03:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.839+0000 7fc8ecc00640 1 -- 172.21.15.5:0/994828404 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8e0018070 con 0x7fc8f0073b30 2024-04-26T22:03:37.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.840+0000 7fc8ecc00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:37.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.840+0000 7fc8ecc00640 1 -- 172.21.15.5:0/994828404 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc8e008bd20 con 0x7fc8f0073b30 2024-04-26T22:03:37.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.841+0000 7fc8e7e00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.842+0000 7fc8e7e00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8f01442c0 tx=0x7fc8d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:37.845+0000 7fc8ecc00640 1 -- 172.21.15.5:0/994828404 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc8e0059790 con 0x7fc8f0073b30 2024-04-26T22:03:38.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.049+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8f0142b70 con 0x7fc8f0073b30 2024-04-26T22:03:38.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.050+0000 7fc8ecc00640 1 -- 172.21.15.5:0/994828404 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fc8e005da90 con 0x7fc8f0073b30 2024-04-26T22:03:38.051 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T22:03:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8cc06c8f0 msgr2=0x7fc8cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8f01442c0 tx=0x7fc8d8008040 comp rx=0 tx=0).stop 2024-04-26T22:03:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 msgr2=0x7fc8f00b9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f00b9eb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000c7c0 tx=0x7fc8e000cc80 comp rx=0 tx=0).stop 2024-04-26T22:03:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 shutdown_connections 2024-04-26T22:03:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8f01469c0 0x7fc8f01ddb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8f00b6d50 0x7fc8f013e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc8cc06c8f0 0x7fc8cc06edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 --2- 172.21.15.5:0/994828404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8f0073b30 0x7fc8f00b9eb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 >> 172.21.15.5:0/994828404 conn(0x7fc8f006c720 msgr2=0x7fc8f00b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 shutdown_connections 2024-04-26T22:03:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.053+0000 7fc8f5c00640 1 -- 172.21.15.5:0/994828404 wait complete. 2024-04-26T22:03:38.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.287+0000 7f0375000640 1 Processor -- start 2024-04-26T22:03:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.287+0000 7f0375000640 1 -- start start 2024-04-26T22:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.288+0000 7f0375000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700735f0 0x7f0370073a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.288+0000 7f0375000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03700b3bb0 con 0x7f03700b6d50 2024-04-26T22:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.288+0000 7f0375000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03700b6260 con 0x7f037014ed10 2024-04-26T22:03:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.288+0000 7f0375000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0370070c20 con 0x7f03700735f0 2024-04-26T22:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.289+0000 7f036f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03700b6d50 0x7f0370146480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46932/0 (socket says 172.21.15.5:46932) 2024-04-26T22:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.289+0000 7f036f400640 1 -- 172.21.15.5:0/3534200429 learned_addr learned my addr 172.21.15.5:0/3534200429 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.289+0000 7f036ea00640 1 --2- 172.21.15.5:0/3534200429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700735f0 0x7f0370073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.289+0000 7f036e000640 1 -- 172.21.15.5:0/3534200429 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281595031 0 0) 0x7f03700b3bb0 con 0x7f03700b6d50 2024-04-26T22:03:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.289+0000 7f036e000640 1 -- 172.21.15.5:0/3534200429 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0354003520 con 0x7f03700b6d50 2024-04-26T22:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.290+0000 7f036ea00640 1 -- 172.21.15.5:0/3534200429 >> v1:172.21.15.112:6789/0 conn(0x7f037014ed10 legacy=0x7f0370151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.290+0000 7f036ea00640 1 -- 172.21.15.5:0/3534200429 >> v1:172.21.15.5:6789/0 conn(0x7f03700b6d50 legacy=0x7f0370146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.290+0000 7f036e000640 1 -- 172.21.15.5:0/3534200429 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803666881 0 0) 0x7f03700b6260 con 0x7f037014ed10 2024-04-26T22:03:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.290+0000 7f036ea00640 1 -- 172.21.15.5:0/3534200429 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03700b7130 con 0x7f03700735f0 2024-04-26T22:03:38.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.291+0000 7f036ea00640 1 --2- 172.21.15.5:0/3534200429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700735f0 0x7f0370073a50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f035c0097d0 tx=0x7f035c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d4be1294c28b8cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.291+0000 7f036e000640 1 -- 172.21.15.5:0/3534200429 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c037070 con 0x7f03700735f0 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.291+0000 7f036e000640 1 -- 172.21.15.5:0/3534200429 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035c02ae40 con 0x7f03700735f0 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.291+0000 7f036e000640 1 -- 172.21.15.5:0/3534200429 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c032660 con 0x7f03700735f0 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.292+0000 7f0375000640 1 -- 172.21.15.5:0/3534200429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700735f0 msgr2=0x7f0370073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.292+0000 7f0375000640 1 --2- 172.21.15.5:0/3534200429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700735f0 0x7f0370073a50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f035c0097d0 tx=0x7f035c02a0f0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.292+0000 7f0375000640 1 -- 172.21.15.5:0/3534200429 shutdown_connections 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.292+0000 7f0375000640 1 --2- 172.21.15.5:0/3534200429 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700735f0 0x7f0370073a50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.292+0000 7f0375000640 1 -- 172.21.15.5:0/3534200429 >> 172.21.15.5:0/3534200429 conn(0x7f037006c720 msgr2=0x7f037006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.292+0000 7f0375000640 1 -- 172.21.15.5:0/3534200429 shutdown_connections 2024-04-26T22:03:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.292+0000 7f0375000640 1 -- 172.21.15.5:0/3534200429 wait complete. 2024-04-26T22:03:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.294+0000 7f0375000640 1 Processor -- start 2024-04-26T22:03:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.294+0000 7f0375000640 1 -- start start 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f0375000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03700735f0 0x7f03701456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f0375000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700b6d50 0x7f03701de580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f0375000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f037014ed10 0x7f03701deac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f0375000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0370073f90 con 0x7f03700735f0 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f0375000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0370070700 con 0x7f037014ed10 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f0375000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f03700b5c40 con 0x7f03700b6d50 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f036f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03700735f0 0x7f03701456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f036f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03700735f0 0x7f03701456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60786/0 (socket says 172.21.15.5:60786) 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f036f400640 1 -- 172.21.15.5:0/3365391208 learned_addr learned my addr 172.21.15.5:0/3365391208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f036ea00640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700b6d50 0x7f03701de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f036f400640 1 -- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700b6d50 msgr2=0x7f03701de580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.295+0000 7f036fe00640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f037014ed10 0x7f03701deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f036f400640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700b6d50 0x7f03701de580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f036f400640 1 -- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f037014ed10 msgr2=0x7f03701deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f036f400640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f037014ed10 0x7f03701deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f036f400640 1 -- 172.21.15.5:0/3365391208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0370142170 con 0x7f03700735f0 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f036ea00640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700b6d50 0x7f03701de580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f036fe00640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f037014ed10 0x7f03701deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f036f400640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03700735f0 0x7f03701456b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f03600010e0 tx=0x7f036000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f0367400640 1 -- 172.21.15.5:0/3365391208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360017070 con 0x7f03700735f0 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f0367400640 1 -- 172.21.15.5:0/3365391208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0360005d00 con 0x7f03700735f0 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037014a220 con 0x7f03700735f0 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f0367400640 1 -- 172.21.15.5:0/3365391208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03600072b0 con 0x7f03700735f0 2024-04-26T22:03:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.296+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0370141e90 con 0x7f03700735f0 2024-04-26T22:03:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.297+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0370075db0 con 0x7f03700735f0 2024-04-26T22:03:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.298+0000 7f0367400640 1 -- 172.21.15.5:0/3365391208 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f036001a070 con 0x7f03700735f0 2024-04-26T22:03:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.299+0000 7f0367400640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f035006c8f0 0x7f035006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.299+0000 7f0367400640 1 -- 172.21.15.5:0/3365391208 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f036008b2f0 con 0x7f03700735f0 2024-04-26T22:03:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.300+0000 7f036ea00640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f035006c8f0 0x7f035006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.301+0000 7f036ea00640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f035006c8f0 0x7f035006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f035c034000 tx=0x7f035c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:38.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.304+0000 7f0367400640 1 -- 172.21.15.5:0/3365391208 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f03600593b0 con 0x7f03700735f0 2024-04-26T22:03:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.512+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f037014a3f0 con 0x7f03700735f0 2024-04-26T22:03:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.513+0000 7f0367400640 1 -- 172.21.15.5:0/3365391208 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f0360058cb0 con 0x7f03700735f0 2024-04-26T22:03:38.514 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f035006c8f0 msgr2=0x7f035006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f035006c8f0 0x7f035006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f035c034000 tx=0x7f035c02e000 comp rx=0 tx=0).stop 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03700735f0 msgr2=0x7f03701456b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03700735f0 0x7f03701456b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f03600010e0 tx=0x7f036000c960 comp rx=0 tx=0).stop 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 shutdown_connections 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f037014ed10 0x7f03701deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03700b6d50 0x7f03701de580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f035006c8f0 0x7f035006edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 --2- 172.21.15.5:0/3365391208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03700735f0 0x7f03701456b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 >> 172.21.15.5:0/3365391208 conn(0x7f037006c720 msgr2=0x7f0370140280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 shutdown_connections 2024-04-26T22:03:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.516+0000 7f0375000640 1 -- 172.21.15.5:0/3365391208 wait complete. 2024-04-26T22:03:38.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:03:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.750+0000 7fb5d4a00640 1 Processor -- start 2024-04-26T22:03:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.750+0000 7fb5d4a00640 1 -- start start 2024-04-26T22:03:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5d4a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 0x7fb5d00b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5d4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb5d00ba450 0x7fb5d014ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5d4a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d00beb30 con 0x7fb5d014bf50 2024-04-26T22:03:38.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5d4a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d00b5c80 con 0x7fb5d00ba450 2024-04-26T22:03:38.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5d4a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d014c3c0 con 0x7fb5d00be750 2024-04-26T22:03:38.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5cfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5d014bf50 0x7fb5d01420b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46942/0 (socket says 172.21.15.5:46942) 2024-04-26T22:03:38.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5cfe00640 1 -- 172.21.15.5:0/378591123 learned_addr learned my addr 172.21.15.5:0/378591123 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:38.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5cea00640 1 --2- 172.21.15.5:0/378591123 >> v2:172.21.15.112:3300/0 conn(0x7fb5d00ba450 0x7fb5d014ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.752+0000 7fb5cf400640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 0x7fb5d00b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496809448 0 0) 0x7fb5d00beb30 con 0x7fb5d014bf50 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b4003520 con 0x7fb5d014bf50 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2005488142 0 0) 0x7fb5b4003520 con 0x7fb5d014bf50 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 msgr2=0x7fb5d00b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 0x7fb5d00b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 >> v2:172.21.15.112:3300/0 conn(0x7fb5d00ba450 msgr2=0x7fb5d014ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 --2- 172.21.15.5:0/378591123 >> v2:172.21.15.112:3300/0 conn(0x7fb5d00ba450 0x7fb5d014ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d00b5630 con 0x7fb5d014bf50 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fb5c8001690 con 0x7fb5d014bf50 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 >> v1:172.21.15.5:6789/0 conn(0x7fb5d014bf50 legacy=0x7fb5d01420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b4004800 0x7fb5b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 0x7fb5b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d00b5c80 con 0x7fb5b40039b0 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d014c3c0 con 0x7fb5b4004800 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b400b9c0 con 0x7fb5d00be750 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.753+0000 7fb5cf400640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cea00640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b4004800 0x7fb5b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cfe00640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 0x7fb5b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cf400640 1 -- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 msgr2=0x7fb5b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cf400640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 0x7fb5b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cf400640 1 -- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b4004800 msgr2=0x7fb5b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cf400640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b4004800 0x7fb5b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cf400640 1 -- 172.21.15.5:0/378591123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b4003520 con 0x7fb5b40039b0 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cea00640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5b4004800 0x7fb5b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.754+0000 7fb5cfe00640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d00be750 0x7fb5b40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.755+0000 7fb5cf400640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5b4003dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009fc0 tx=0x7fb5b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff4275d0cba5716 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.755+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0009c10 con 0x7fb5b40039b0 2024-04-26T22:03:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.755+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c0036070 con 0x7fb5b40039b0 2024-04-26T22:03:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.755+0000 7fb5ce000640 1 -- 172.21.15.5:0/378591123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0031850 con 0x7fb5b40039b0 2024-04-26T22:03:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.756+0000 7fb5d4a00640 1 -- 172.21.15.5:0/378591123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 msgr2=0x7fb5b4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.756+0000 7fb5d4a00640 1 --2- 172.21.15.5:0/378591123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5b4003dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009fc0 tx=0x7fb5b4005830 comp rx=0 tx=0).stop 2024-04-26T22:03:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.756+0000 7fb5cfe00640 1 -- 172.21.15.5:0/378591123 reap_dead start 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.756+0000 7fb5d4a00640 1 -- 172.21.15.5:0/378591123 shutdown_connections 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.756+0000 7fb5d4a00640 1 -- 172.21.15.5:0/378591123 >> 172.21.15.5:0/378591123 conn(0x7fb5d00686c0 msgr2=0x7fb5d00bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.756+0000 7fb5d4a00640 1 -- 172.21.15.5:0/378591123 shutdown_connections 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.756+0000 7fb5d4a00640 1 -- 172.21.15.5:0/378591123 wait complete. 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.758+0000 7fb5d4a00640 1 Processor -- start 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.758+0000 7fb5d4a00640 1 -- start start 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5d4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5d00aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5d4a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d01dd850 0x7fb5d01ddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5d4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5d00b3660 0x7fb5d00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5d4a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d0142940 con 0x7fb5b40039b0 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5d4a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d01427c0 con 0x7fb5d00b3660 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5d4a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d0142ac0 con 0x7fb5d01dd850 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5d00aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5d00aa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60804/0 (socket says 172.21.15.5:60804) 2024-04-26T22:03:38.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cf400640 1 -- 172.21.15.5:0/1447718708 learned_addr learned my addr 172.21.15.5:0/1447718708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cea00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d01dd850 0x7fb5d01ddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cf400640 1 -- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d01dd850 msgr2=0x7fb5d01ddcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cf400640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d01dd850 0x7fb5d01ddcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cf400640 1 -- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5d00b3660 msgr2=0x7fb5d00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cfe00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5d00b3660 0x7fb5d00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.759+0000 7fb5cf400640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5d00b3660 0x7fb5d00b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5cf400640 1 -- 172.21.15.5:0/1447718708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d01de210 con 0x7fb5b40039b0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5cea00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d01dd850 0x7fb5d01ddcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5cf400640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5d00aa670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb5c002aeb0 tx=0x7fb5c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5c7400640 1 -- 172.21.15.5:0/1447718708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0009c10 con 0x7fb5b40039b0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5c7400640 1 -- 172.21.15.5:0/1447718708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c0003b90 con 0x7fb5b40039b0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5c7400640 1 -- 172.21.15.5:0/1447718708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0004020 con 0x7fb5b40039b0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d00ad100 con 0x7fb5b40039b0 2024-04-26T22:03:38.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.760+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d00ace20 con 0x7fb5b40039b0 2024-04-26T22:03:38.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.761+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d00ab020 con 0x7fb5b40039b0 2024-04-26T22:03:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.762+0000 7fb5c7400640 1 -- 172.21.15.5:0/1447718708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5c0005d10 con 0x7fb5b40039b0 2024-04-26T22:03:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.763+0000 7fb5c7400640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb5ac06c8f0 0x7fb5ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.763+0000 7fb5c7400640 1 -- 172.21.15.5:0/1447718708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb5c00ad3a0 con 0x7fb5b40039b0 2024-04-26T22:03:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.764+0000 7fb5cea00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb5ac06c8f0 0x7fb5ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.765+0000 7fb5cea00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb5ac06c8f0 0x7fb5ac06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0145030 tx=0x7fb5b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:38.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.768+0000 7fb5c7400640 1 -- 172.21.15.5:0/1447718708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb5d01de210 con 0x7fb5b40039b0 2024-04-26T22:03:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.970+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb5d0075db0 con 0x7fb5b40039b0 2024-04-26T22:03:38.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.971+0000 7fb5c7400640 1 -- 172.21.15.5:0/1447718708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fb5c002e050 con 0x7fb5b40039b0 2024-04-26T22:03:38.972 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-26T22:03:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb5ac06c8f0 msgr2=0x7fb5ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb5ac06c8f0 0x7fb5ac06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0145030 tx=0x7fb5b8008040 comp rx=0 tx=0).stop 2024-04-26T22:03:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 msgr2=0x7fb5d00aa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5d00aa670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb5c002aeb0 tx=0x7fb5c0009750 comp rx=0 tx=0).stop 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 shutdown_connections 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5d00b3660 0x7fb5d00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb5d01dd850 0x7fb5d01ddcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb5ac06c8f0 0x7fb5ac06edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 --2- 172.21.15.5:0/1447718708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b40039b0 0x7fb5d00aa670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 >> 172.21.15.5:0/1447718708 conn(0x7fb5d00686c0 msgr2=0x7fb5d00b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 shutdown_connections 2024-04-26T22:03:38.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:38.974+0000 7fb5d4a00640 1 -- 172.21.15.5:0/1447718708 wait complete. 2024-04-26T22:03:38.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T22:03:39.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.213+0000 7f1b5f200640 1 Processor -- start 2024-04-26T22:03:39.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.214+0000 7f1b5f200640 1 -- start start 2024-04-26T22:03:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.215+0000 7f1b5f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 0x7f1b580b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.215+0000 7f1b5f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b580b6d90 con 0x7f1b580b69b0 2024-04-26T22:03:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.215+0000 7f1b5f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b581487d0 con 0x7f1b581421a0 2024-04-26T22:03:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.215+0000 7f1b5f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1b581493f0 con 0x7f1b58148fd0 2024-04-26T22:03:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.215+0000 7f1b5de00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1b580b69b0 0x7f1b580b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46952/0 (socket says 172.21.15.5:46952) 2024-04-26T22:03:39.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.215+0000 7f1b5de00640 1 -- 172.21.15.5:0/105978330 learned_addr learned my addr 172.21.15.5:0/105978330 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5d400640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 0x7f1b580b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116072554 0 0) 0x7f1b580b6d90 con 0x7f1b580b69b0 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b40003520 con 0x7f1b580b69b0 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4035199994 0 0) 0x7f1b40003520 con 0x7f1b580b69b0 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 msgr2=0x7f1b580b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 0x7f1b580b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 >> v1:172.21.15.112:6789/0 conn(0x7f1b581421a0 legacy=0x7f1b58142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b58148ab0 con 0x7f1b580b69b0 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f1b4c0019f0 con 0x7f1b580b69b0 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.216+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 >> v1:172.21.15.5:6789/0 conn(0x7f1b580b69b0 legacy=0x7f1b580b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5ca00640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b400039e0 0x7f1b40003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5ca00640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 0x7f1b40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5ca00640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4000bb50 con 0x7f1b40004d40 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4000bcd0 con 0x7f1b400039e0 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4000bed0 con 0x7f1b58148fd0 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5e800640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5d400640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 0x7f1b40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5de00640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b400039e0 0x7f1b40003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5e800640 1 -- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 msgr2=0x7f1b40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5e800640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b58148fd0 0x7f1b40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5e800640 1 -- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b400039e0 msgr2=0x7f1b40003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5e800640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b400039e0 0x7f1b40003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.217+0000 7f1b5e800640 1 -- 172.21.15.5:0/105978330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b40003520 con 0x7f1b40004d40 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.218+0000 7f1b5e800640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001750 tx=0x7f1b40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b62492515ef7c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54001370 con 0x7f1b40004d40 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b540052d0 con 0x7f1b40004d40 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5ca00640 1 -- 172.21.15.5:0/105978330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5402abe0 con 0x7f1b40004d40 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5f200640 1 -- 172.21.15.5:0/105978330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 msgr2=0x7f1b400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5f200640 1 --2- 172.21.15.5:0/105978330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b400051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001750 tx=0x7f1b40005830 comp rx=0 tx=0).stop 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5e800640 1 -- 172.21.15.5:0/105978330 reap_dead start 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5f200640 1 -- 172.21.15.5:0/105978330 shutdown_connections 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5f200640 1 -- 172.21.15.5:0/105978330 >> 172.21.15.5:0/105978330 conn(0x7f1b580bde50 msgr2=0x7f1b580be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.219+0000 7f1b5f200640 1 -- 172.21.15.5:0/105978330 shutdown_connections 2024-04-26T22:03:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.220+0000 7f1b5f200640 1 -- 172.21.15.5:0/105978330 wait complete. 2024-04-26T22:03:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.221+0000 7f1b5f200640 1 Processor -- start 2024-04-26T22:03:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.221+0000 7f1b5f200640 1 -- start start 2024-04-26T22:03:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.222+0000 7f1b5f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b581d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.222+0000 7f1b5f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b581cff20 0x7f1b581d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.222+0000 7f1b5f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b581dde90 0x7f1b581de310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.222+0000 7f1b5f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b580ba720 con 0x7f1b40004d40 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.222+0000 7f1b5f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b580ba5a0 con 0x7f1b581dde90 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.222+0000 7f1b5f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1b580b87d0 con 0x7f1b581cff20 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.222+0000 7f1b5de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b581d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b581d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60810/0 (socket says 172.21.15.5:60810) 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 -- 172.21.15.5:0/3070335193 learned_addr learned my addr 172.21.15.5:0/3070335193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 -- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b581cff20 msgr2=0x7f1b581d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b581cff20 0x7f1b581d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 -- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b581dde90 msgr2=0x7f1b581de310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5e800640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b581dde90 0x7f1b581de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b581dde90 0x7f1b581de310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 -- 172.21.15.5:0/3070335193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b581d0380 con 0x7f1b40004d40 2024-04-26T22:03:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.223+0000 7f1b5de00640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b581d0d40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c007a60 tx=0x7f1b4c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.224+0000 7f1b52000640 1 -- 172.21.15.5:0/3070335193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00ee50 con 0x7f1b40004d40 2024-04-26T22:03:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.224+0000 7f1b52000640 1 -- 172.21.15.5:0/3070335193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c018070 con 0x7f1b40004d40 2024-04-26T22:03:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.224+0000 7f1b52000640 1 -- 172.21.15.5:0/3070335193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c013640 con 0x7f1b40004d40 2024-04-26T22:03:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.224+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b581cf420 con 0x7f1b40004d40 2024-04-26T22:03:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.224+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b581de850 con 0x7f1b40004d40 2024-04-26T22:03:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.225+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b58075db0 con 0x7f1b40004d40 2024-04-26T22:03:39.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.226+0000 7f1b52000640 1 -- 172.21.15.5:0/3070335193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b4c0137e0 con 0x7f1b40004d40 2024-04-26T22:03:39.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.227+0000 7f1b52000640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f1b3c06ca90 0x7f1b3c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.227+0000 7f1b52000640 1 -- 172.21.15.5:0/3070335193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1b4c08c6c0 con 0x7f1b40004d40 2024-04-26T22:03:39.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.227+0000 7f1b5d400640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f1b3c06ca90 0x7f1b3c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.229+0000 7f1b5d400640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f1b3c06ca90 0x7f1b3c06ef50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b581463c0 tx=0x7f1b48008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.231+0000 7f1b52000640 1 -- 172.21.15.5:0/3070335193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1b4c05a6e0 con 0x7f1b40004d40 2024-04-26T22:03:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.438+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1b581cf790 con 0x7f1b40004d40 2024-04-26T22:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.439+0000 7f1b52000640 1 -- 172.21.15.5:0/3070335193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f1b4c059fe0 con 0x7f1b40004d40 2024-04-26T22:03:39.441 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T22:03:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f1b3c06ca90 msgr2=0x7f1b3c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f1b3c06ca90 0x7f1b3c06ef50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b581463c0 tx=0x7f1b48008040 comp rx=0 tx=0).stop 2024-04-26T22:03:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 msgr2=0x7f1b581d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b581d0d40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c007a60 tx=0x7f1b4c00e530 comp rx=0 tx=0).stop 2024-04-26T22:03:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 shutdown_connections 2024-04-26T22:03:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b581dde90 0x7f1b581de310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b581cff20 0x7f1b581d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f1b3c06ca90 0x7f1b3c06ef50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 --2- 172.21.15.5:0/3070335193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b40004d40 0x7f1b581d0d40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 >> 172.21.15.5:0/3070335193 conn(0x7f1b580bde50 msgr2=0x7f1b581475a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 shutdown_connections 2024-04-26T22:03:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.442+0000 7f1b5f200640 1 -- 172.21.15.5:0/3070335193 wait complete. 2024-04-26T22:03:39.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:03:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.667+0000 7f12c3e00640 1 Processor -- start 2024-04-26T22:03:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.667+0000 7f12c3e00640 1 -- start start 2024-04-26T22:03:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.668+0000 7f12c3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.668+0000 7f12c3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12c40b5fc0 0x7f12c4073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.668+0000 7f12c3e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c4070bc0 con 0x7f12c4146f80 2024-04-26T22:03:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.668+0000 7f12c3e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f12c40b43e0 con 0x7f12c40b5fc0 2024-04-26T22:03:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.668+0000 7f12c3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f12c4071c20 con 0x7f12c40b3360 2024-04-26T22:03:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.669+0000 7f12c3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12c4146f80 0x7f12c4149880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46958/0 (socket says 172.21.15.5:46958) 2024-04-26T22:03:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.669+0000 7f12c3400640 1 -- 172.21.15.5:0/2624135118 learned_addr learned my addr 172.21.15.5:0/2624135118 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.669+0000 7f12c2000640 1 --2- 172.21.15.5:0/2624135118 >> v2:172.21.15.5:3300/0 conn(0x7f12c40b5fc0 0x7f12c4073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.669+0000 7f12c2a00640 1 --2- 172.21.15.5:0/2624135118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.670+0000 7f12c1600640 1 -- 172.21.15.5:0/2624135118 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741744274 0 0) 0x7f12c4070bc0 con 0x7f12c4146f80 2024-04-26T22:03:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.670+0000 7f12c1600640 1 -- 172.21.15.5:0/2624135118 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a8003520 con 0x7f12c4146f80 2024-04-26T22:03:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.670+0000 7f12c2000640 1 -- 172.21.15.5:0/2624135118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 msgr2=0x7f12c4146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.670+0000 7f12c2000640 1 --2- 172.21.15.5:0/2624135118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.670+0000 7f12c2000640 1 -- 172.21.15.5:0/2624135118 >> v1:172.21.15.5:6789/0 conn(0x7f12c4146f80 legacy=0x7f12c4149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.670+0000 7f12c2000640 1 -- 172.21.15.5:0/2624135118 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c40b3740 con 0x7f12c40b5fc0 2024-04-26T22:03:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.671+0000 7f12c2000640 1 --2- 172.21.15.5:0/2624135118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c40b5fc0 0x7f12c4073610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f12b00097d0 tx=0x7f12b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6273cdfb37e2a8c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.671+0000 7f12c1600640 1 -- 172.21.15.5:0/2624135118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0037070 con 0x7f12c40b5fc0 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.671+0000 7f12c1600640 1 -- 172.21.15.5:0/2624135118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b0032440 con 0x7f12c40b5fc0 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.671+0000 7f12c1600640 1 -- 172.21.15.5:0/2624135118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0032810 con 0x7f12c40b5fc0 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 -- 172.21.15.5:0/2624135118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c40b5fc0 msgr2=0x7f12c4073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2624135118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c40b5fc0 0x7f12c4073610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f12b00097d0 tx=0x7f12b002a1c0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 -- 172.21.15.5:0/2624135118 shutdown_connections 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2624135118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c40b5fc0 0x7f12c4073610 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2624135118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 -- 172.21.15.5:0/2624135118 >> 172.21.15.5:0/2624135118 conn(0x7f12c406c300 msgr2=0x7f12c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 -- 172.21.15.5:0/2624135118 shutdown_connections 2024-04-26T22:03:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.672+0000 7f12c3e00640 1 -- 172.21.15.5:0/2624135118 wait complete. 2024-04-26T22:03:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.673+0000 7f12c3e00640 1 Processor -- start 2024-04-26T22:03:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.674+0000 7f12c3e00640 1 -- start start 2024-04-26T22:03:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.674+0000 7f12c3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.674+0000 7f12c3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c40b5fc0 0x7f12c41d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.674+0000 7f12c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c4146f80 0x7f12c41e1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.674+0000 7f12c3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12c406ebc0 con 0x7f12c4146f80 2024-04-26T22:03:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.674+0000 7f12c3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12c4146520 con 0x7f12c40b5fc0 2024-04-26T22:03:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.674+0000 7f12c3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f12c40b3d10 con 0x7f12c40b3360 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.675+0000 7f12c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c4146f80 0x7f12c41e1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.675+0000 7f12c2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.675+0000 7f12c2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c40b5fc0 0x7f12c41d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.675+0000 7f12c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c4146f80 0x7f12c41e1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60828/0 (socket says 172.21.15.5:60828) 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.675+0000 7f12c3400640 1 -- 172.21.15.5:0/2785866657 learned_addr learned my addr 172.21.15.5:0/2785866657 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12c3400640 1 -- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 msgr2=0x7f12c4140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12c3400640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12c3400640 1 -- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c40b5fc0 msgr2=0x7f12c41d4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12c3400640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c40b5fc0 0x7f12c41d4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12c3400640 1 -- 172.21.15.5:0/2785866657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c4143490 con 0x7f12c4146f80 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12c3400640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c4146f80 0x7f12c41e1690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00cad0 tx=0x7f12bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12baa00640 1 -- 172.21.15.5:0/2785866657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc017070 con 0x7f12c4146f80 2024-04-26T22:03:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12baa00640 1 -- 172.21.15.5:0/2785866657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc00ac30 con 0x7f12c4146f80 2024-04-26T22:03:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12baa00640 1 -- 172.21.15.5:0/2785866657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc012400 con 0x7f12c4146f80 2024-04-26T22:03:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.676+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c41e0bb0 con 0x7f12c4146f80 2024-04-26T22:03:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.677+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c41e1170 con 0x7f12c4146f80 2024-04-26T22:03:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.678+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c4075db0 con 0x7f12c4146f80 2024-04-26T22:03:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.679+0000 7f12baa00640 1 -- 172.21.15.5:0/2785866657 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12bc01a070 con 0x7f12c4146f80 2024-04-26T22:03:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.680+0000 7f12baa00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f12a406c920 0x7f12a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.680+0000 7f12baa00640 1 -- 172.21.15.5:0/2785866657 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f12bc08bba0 con 0x7f12c4146f80 2024-04-26T22:03:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.680+0000 7f12c2a00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f12a406c920 0x7f12a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:39.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.681+0000 7f12c2a00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f12a406c920 0x7f12a406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009b40 tx=0x7f12b4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.684+0000 7f12baa00640 1 -- 172.21.15.5:0/2785866657 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f12bc059610 con 0x7f12c4146f80 2024-04-26T22:03:39.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:03:39.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:03:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.910+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f12c40afd30 con 0x7f12c4146f80 2024-04-26T22:03:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.911+0000 7f12baa00640 1 -- 172.21.15.5:0/2785866657 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f12bc05d910 con 0x7f12c4146f80 2024-04-26T22:03:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-26T22:03:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f12a406c920 msgr2=0x7f12a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f12a406c920 0x7f12a406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009b40 tx=0x7f12b4009190 comp rx=0 tx=0).stop 2024-04-26T22:03:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c4146f80 msgr2=0x7f12c41e1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c4146f80 0x7f12c41e1690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00cad0 tx=0x7f12bc00cf90 comp rx=0 tx=0).stop 2024-04-26T22:03:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 shutdown_connections 2024-04-26T22:03:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f12a406c920 0x7f12a406ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12c4146f80 0x7f12c41e1690 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12c40b5fc0 0x7f12c41d4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 --2- 172.21.15.5:0/2785866657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12c40b3360 0x7f12c4140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 >> 172.21.15.5:0/2785866657 conn(0x7f12c406c300 msgr2=0x7f12c40b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 shutdown_connections 2024-04-26T22:03:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:39.914+0000 7f12c3e00640 1 -- 172.21.15.5:0/2785866657 wait complete. 2024-04-26T22:03:39.934 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-26T22:03:39.934 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:40.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:03:40.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.284+0000 7f7403200640 1 Processor -- start 2024-04-26T22:03:40.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.285+0000 7f7403200640 1 -- start start 2024-04-26T22:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.286+0000 7f7403200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73fc0b6d50 0x7f73fc0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.286+0000 7f7403200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc0b7130 con 0x7f73fc0b3e20 2024-04-26T22:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.286+0000 7f7403200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc0b17d0 con 0x7f73fc146f90 2024-04-26T22:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.286+0000 7f7403200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc0b1580 con 0x7f73fc0b6d50 2024-04-26T22:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.286+0000 7f73fb400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f73fc0b3e20 0x7f73fc146880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46962/0 (socket says 172.21.15.5:46962) 2024-04-26T22:03:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.286+0000 7f73fb400640 1 -- 172.21.15.5:0/3903835793 learned_addr learned my addr 172.21.15.5:0/3903835793 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73fbe00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73fc0b6d50 0x7f73fc0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3295593341 0 0) 0x7f73fc0b7130 con 0x7f73fc0b3e20 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73dc003520 con 0x7f73fc0b3e20 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1460164964 0 0) 0x7f73dc003520 con 0x7f73fc0b3e20 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73fc0b6d50 msgr2=0x7f73fc0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73fc0b6d50 0x7f73fc0b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 >> v1:172.21.15.112:6789/0 conn(0x7f73fc146f90 legacy=0x7f73fc1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc0b1160 con 0x7f73fc0b3e20 2024-04-26T22:03:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f73e40019f0 con 0x7f73fc0b3e20 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 >> v1:172.21.15.5:6789/0 conn(0x7f73fc0b3e20 legacy=0x7f73fc146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc0039e0 0x7f73dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc004800 0x7f73dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.287+0000 7f73faa00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73fc0b6d50 0x7f73dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b1580 con 0x7f73dc0039e0 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc00baf0 con 0x7f73dc004800 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f73dc00bcf0 con 0x7f73fc0b6d50 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73fbe00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc0039e0 0x7f73dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73fb400640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc004800 0x7f73dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73fbe00640 1 -- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73fc0b6d50 msgr2=0x7f73dc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73fbe00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73fc0b6d50 0x7f73dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73fbe00640 1 -- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc004800 msgr2=0x7f73dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73fbe00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73dc004800 0x7f73dc004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.288+0000 7f73fbe00640 1 -- 172.21.15.5:0/3903835793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc003520 con 0x7f73dc0039e0 2024-04-26T22:03:40.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.289+0000 7f73fbe00640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc0039e0 0x7f73dc003e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009ac0 tx=0x7f73dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddb0e42199f3b89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec036070 con 0x7f73dc0039e0 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec031400 con 0x7f73dc0039e0 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f73faa00640 1 -- 172.21.15.5:0/3903835793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec009690 con 0x7f73dc0039e0 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f7403200640 1 -- 172.21.15.5:0/3903835793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc0039e0 msgr2=0x7f73dc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f7403200640 1 --2- 172.21.15.5:0/3903835793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73dc0039e0 0x7f73dc003e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009ac0 tx=0x7f73dc005830 comp rx=0 tx=0).stop 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f7401200640 1 -- 172.21.15.5:0/3903835793 reap_dead start 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f7403200640 1 -- 172.21.15.5:0/3903835793 shutdown_connections 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f7403200640 1 -- 172.21.15.5:0/3903835793 >> 172.21.15.5:0/3903835793 conn(0x7f73fc06c720 msgr2=0x7f73fc06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f7403200640 1 -- 172.21.15.5:0/3903835793 shutdown_connections 2024-04-26T22:03:40.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.290+0000 7f7403200640 1 -- 172.21.15.5:0/3903835793 wait complete. 2024-04-26T22:03:40.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.292+0000 7f7403200640 1 Processor -- start 2024-04-26T22:03:40.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.292+0000 7f7403200640 1 -- start start 2024-04-26T22:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f7403200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73dc0039e0 0x7f73fc14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f7403200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73fc1e2530 0x7f73fc1e29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f7403200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc13d4c0 0x7f73fc13d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f7403200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b0cc0 con 0x7f73fc1e2530 2024-04-26T22:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f7403200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b0b40 con 0x7f73fc13d4c0 2024-04-26T22:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f7403200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc0b6350 con 0x7f73dc0039e0 2024-04-26T22:03:40.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f73fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73fc1e2530 0x7f73fc1e29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f73fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73fc1e2530 0x7f73fc1e29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60854/0 (socket says 172.21.15.5:60854) 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.293+0000 7f73fb400640 1 -- 172.21.15.5:0/2456392193 learned_addr learned my addr 172.21.15.5:0/2456392193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fbe00640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73dc0039e0 0x7f73fc14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f7401200640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc13d4c0 0x7f73fc13d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fb400640 1 -- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73dc0039e0 msgr2=0x7f73fc14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fb400640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73dc0039e0 0x7f73fc14bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fb400640 1 -- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc13d4c0 msgr2=0x7f73fc13d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fb400640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc13d4c0 0x7f73fc13d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fb400640 1 -- 172.21.15.5:0/2456392193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc13e220 con 0x7f73fc1e2530 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fbe00640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73dc0039e0 0x7f73fc14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73fb400640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73fc1e2530 0x7f73fc1e29b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f73e4002130 tx=0x7f73e400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73f3e00640 1 -- 172.21.15.5:0/2456392193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4019070 con 0x7f73fc1e2530 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73f3e00640 1 -- 172.21.15.5:0/2456392193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e4004d60 con 0x7f73fc1e2530 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.294+0000 7f73f3e00640 1 -- 172.21.15.5:0/2456392193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e40072d0 con 0x7f73fc1e2530 2024-04-26T22:03:40.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.295+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc1e2ef0 con 0x7f73fc1e2530 2024-04-26T22:03:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.295+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc14aa10 con 0x7f73fc1e2530 2024-04-26T22:03:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.296+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73fc0b4f20 con 0x7f73fc1e2530 2024-04-26T22:03:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.297+0000 7f73f3e00640 1 -- 172.21.15.5:0/2456392193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73e401c070 con 0x7f73fc1e2530 2024-04-26T22:03:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.298+0000 7f73f3e00640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f73d806c8f0 0x7f73d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.298+0000 7f73f3e00640 1 -- 172.21.15.5:0/2456392193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f73e408c150 con 0x7f73fc1e2530 2024-04-26T22:03:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.298+0000 7f73fbe00640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f73d806c8f0 0x7f73d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.300+0000 7f73fbe00640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f73d806c8f0 0x7f73d806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73ec033000 tx=0x7f73ec008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.302+0000 7f73f3e00640 1 -- 172.21.15.5:0/2456392193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f73fc0b4f20 con 0x7f73fc1e2530 2024-04-26T22:03:40.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.510+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73fc0b36b0 con 0x7f73fc1e2530 2024-04-26T22:03:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.511+0000 7f73f3e00640 1 -- 172.21.15.5:0/2456392193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18776 (secure 0 0 0) 0x7f73fc1e2ef0 con 0x7f73fc1e2530 2024-04-26T22:03:40.513 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:03:40.513 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:58.718657+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:03:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f73d806c8f0 msgr2=0x7f73d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f73d806c8f0 0x7f73d806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73ec033000 tx=0x7f73ec008030 comp rx=0 tx=0).stop 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73fc1e2530 msgr2=0x7f73fc1e29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73fc1e2530 0x7f73fc1e29b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f73e4002130 tx=0x7f73e400b4a0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 shutdown_connections 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73fc13d4c0 0x7f73fc13d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f73d806c8f0 0x7f73d806edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73fc1e2530 0x7f73fc1e29b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 --2- 172.21.15.5:0/2456392193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f73dc0039e0 0x7f73fc14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.514+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 >> 172.21.15.5:0/2456392193 conn(0x7f73fc06c720 msgr2=0x7f73fc0b86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:40.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.515+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 shutdown_connections 2024-04-26T22:03:40.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.515+0000 7f7403200640 1 -- 172.21.15.5:0/2456392193 wait complete. 2024-04-26T22:03:40.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:37:05.484084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:37:14.651248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:37:15.859697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:37:19.462053+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T22:03:40.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:03:40.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.756+0000 7fbdc7000640 1 Processor -- start 2024-04-26T22:03:40.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.756+0000 7fbdc7000640 1 -- start start 2024-04-26T22:03:40.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.758+0000 7fbdc7000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 0x7fbdc0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.758+0000 7fbdc7000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc00b41d0 con 0x7fbdc006d150 2024-04-26T22:03:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.758+0000 7fbdc7000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc006e010 con 0x7fbdc006dc30 2024-04-26T22:03:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.758+0000 7fbdc7000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc0073bc0 con 0x7fbdc014c2c0 2024-04-26T22:03:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.758+0000 7fbdbf400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbdc006d150 0x7fbdc014bbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46966/0 (socket says 172.21.15.5:46966) 2024-04-26T22:03:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.758+0000 7fbdbf400640 1 -- 172.21.15.5:0/440309154 learned_addr learned my addr 172.21.15.5:0/440309154 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.758+0000 7fbdc5000640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 0x7fbdc0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212724586 0 0) 0x7fbdc00b41d0 con 0x7fbdc006d150 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda4003520 con 0x7fbdc006d150 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 860875827 0 0) 0x7fbda4003520 con 0x7fbdc006d150 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 msgr2=0x7fbdc0153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 0x7fbdc0153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 >> v1:172.21.15.112:6789/0 conn(0x7fbdc006dc30 legacy=0x7fbdc00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc0073ea0 con 0x7fbdc006d150 2024-04-26T22:03:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fbda8001670 con 0x7fbdc006d150 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 >> v1:172.21.15.5:6789/0 conn(0x7fbdc006d150 legacy=0x7fbdc014bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbda4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbda4004800 0x7fbda4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 0x7fbda4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc0073bc0 con 0x7fbda40039e0 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbda400baf0 con 0x7fbda4004800 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.759+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbda400bcf0 con 0x7fbdc014c2c0 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdbfe00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbda4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdbf400640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbda4004800 0x7fbda4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdc5000640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 0x7fbda4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdbfe00640 1 -- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 msgr2=0x7fbda4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdbfe00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 0x7fbda4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdbfe00640 1 -- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbda4004800 msgr2=0x7fbda4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:40.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdbfe00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbda4004800 0x7fbda4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdbfe00640 1 -- 172.21.15.5:0/440309154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda4003520 con 0x7fbda40039e0 2024-04-26T22:03:40.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.760+0000 7fbdc5000640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc014c2c0 0x7fbda4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.761+0000 7fbdbfe00640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbda4003e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0001750 tx=0x7fbda4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c00d89f8755a35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.761+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0001370 con 0x7fbda40039e0 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.761+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb00052d0 con 0x7fbda40039e0 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.761+0000 7fbdbea00640 1 -- 172.21.15.5:0/440309154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb002abe0 con 0x7fbda40039e0 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.762+0000 7fbdc7000640 1 -- 172.21.15.5:0/440309154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 msgr2=0x7fbda4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.762+0000 7fbdc7000640 1 --2- 172.21.15.5:0/440309154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbda4003e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0001750 tx=0x7fbda4005830 comp rx=0 tx=0).stop 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.762+0000 7fbdc5000640 1 -- 172.21.15.5:0/440309154 reap_dead start 2024-04-26T22:03:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.762+0000 7fbdc7000640 1 -- 172.21.15.5:0/440309154 shutdown_connections 2024-04-26T22:03:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.762+0000 7fbdc7000640 1 -- 172.21.15.5:0/440309154 >> 172.21.15.5:0/440309154 conn(0x7fbdc00b7bb0 msgr2=0x7fbdc00b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.762+0000 7fbdc7000640 1 -- 172.21.15.5:0/440309154 shutdown_connections 2024-04-26T22:03:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.762+0000 7fbdc7000640 1 -- 172.21.15.5:0/440309154 wait complete. 2024-04-26T22:03:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.764+0000 7fbdc7000640 1 Processor -- start 2024-04-26T22:03:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.764+0000 7fbdc7000640 1 -- start start 2024-04-26T22:03:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdc7000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbdc00b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdc7000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc01e1870 0x7fbdc01e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdc7000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc01406b0 0x7fbdc0140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdc7000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc006c610 con 0x7fbda40039e0 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdc7000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc006c490 con 0x7fbdc01406b0 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdc7000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc0151f40 con 0x7fbdc01e1870 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdbfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbdc00b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdbfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbdc00b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60882/0 (socket says 172.21.15.5:60882) 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdbfe00640 1 -- 172.21.15.5:0/1113115731 learned_addr learned my addr 172.21.15.5:0/1113115731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdc5000640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc01406b0 0x7fbdc0140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.765+0000 7fbdbf400640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc01e1870 0x7fbdc01e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdbfe00640 1 -- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc01e1870 msgr2=0x7fbdc01e1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdbfe00640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc01e1870 0x7fbdc01e1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdbfe00640 1 -- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc01406b0 msgr2=0x7fbdc0140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdbfe00640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc01406b0 0x7fbdc0140b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdbfe00640 1 -- 172.21.15.5:0/1113115731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc01486e0 con 0x7fbda40039e0 2024-04-26T22:03:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdbf400640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc01e1870 0x7fbdc01e1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdbfe00640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbdc00b2f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0001870 tx=0x7fbdb0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdb7e00640 1 -- 172.21.15.5:0/1113115731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0037040 con 0x7fbda40039e0 2024-04-26T22:03:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdb7e00640 1 -- 172.21.15.5:0/1113115731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb0005480 con 0x7fbda40039e0 2024-04-26T22:03:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdb7e00640 1 -- 172.21.15.5:0/1113115731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0001370 con 0x7fbda40039e0 2024-04-26T22:03:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.766+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc01e2210 con 0x7fbda40039e0 2024-04-26T22:03:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.767+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc0142460 con 0x7fbda40039e0 2024-04-26T22:03:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.768+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc0075db0 con 0x7fbda40039e0 2024-04-26T22:03:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.769+0000 7fbdb7e00640 1 -- 172.21.15.5:0/1113115731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdb0044020 con 0x7fbda40039e0 2024-04-26T22:03:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.770+0000 7fbdb7e00640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbd9c06c970 0x7fbd9c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.770+0000 7fbdb7e00640 1 -- 172.21.15.5:0/1113115731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbdb0007640 con 0x7fbda40039e0 2024-04-26T22:03:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.770+0000 7fbdbf400640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbd9c06c970 0x7fbd9c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.772+0000 7fbdbf400640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbd9c06c970 0x7fbd9c06ee30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbda8001200 tx=0x7fbda8000f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:40.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.774+0000 7fbdb7e00640 1 -- 172.21.15.5:0/1113115731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbdb0079da0 con 0x7fbda40039e0 2024-04-26T22:03:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.983+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbdc006cf30 con 0x7fbda40039e0 2024-04-26T22:03:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.984+0000 7fbdb7e00640 1 -- 172.21.15.5:0/1113115731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fbdb00796a0 con 0x7fbda40039e0 2024-04-26T22:03:40.985 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbd9c06c970 msgr2=0x7fbd9c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbd9c06c970 0x7fbd9c06ee30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbda8001200 tx=0x7fbda8000f30 comp rx=0 tx=0).stop 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 msgr2=0x7fbdc00b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbdc00b2f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0001870 tx=0x7fbdb0001120 comp rx=0 tx=0).stop 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 shutdown_connections 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdc01406b0 0x7fbdc0140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbdc01e1870 0x7fbdc01e1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fbd9c06c970 0x7fbd9c06ee30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 --2- 172.21.15.5:0/1113115731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda40039e0 0x7fbdc00b2f40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 >> 172.21.15.5:0/1113115731 conn(0x7fbdc00b7bb0 msgr2=0x7fbdc00b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 shutdown_connections 2024-04-26T22:03:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:40.987+0000 7fbdc7000640 1 -- 172.21.15.5:0/1113115731 wait complete. 2024-04-26T22:03:41.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:03:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.213+0000 7ff660000640 1 Processor -- start 2024-04-26T22:03:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.213+0000 7ff660000640 1 -- start start 2024-04-26T22:03:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.214+0000 7ff660000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff658071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.214+0000 7ff660000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6580b4940 0x7ff6580721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.214+0000 7ff660000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff658074240 con 0x7ff6580b1390 2024-04-26T22:03:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.214+0000 7ff660000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff6580b1f80 con 0x7ff6580b4940 2024-04-26T22:03:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.214+0000 7ff660000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff6580a03f0 con 0x7ff6580a0010 2024-04-26T22:03:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6580b4940 0x7ff6580721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6580b4940 0x7ff6580721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60884/0 (socket says 172.21.15.5:60884) 2024-04-26T22:03:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65cc00640 1 -- 172.21.15.5:0/1951553697 learned_addr learned my addr 172.21.15.5:0/1951553697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65e000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff6580b1390 0x7ff6581424a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46968/0 (socket says 172.21.15.5:46968) 2024-04-26T22:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65d600640 1 --2- 172.21.15.5:0/1951553697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff658071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65cc00640 1 -- 172.21.15.5:0/1951553697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 msgr2=0x7ff658071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65cc00640 1 --2- 172.21.15.5:0/1951553697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff658071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65cc00640 1 -- 172.21.15.5:0/1951553697 >> v1:172.21.15.5:6789/0 conn(0x7ff6580b1390 legacy=0x7ff6581424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff65cc00640 1 -- 172.21.15.5:0/1951553697 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff658072720 con 0x7ff6580b4940 2024-04-26T22:03:41.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.215+0000 7ff657e00640 1 -- 172.21.15.5:0/1951553697 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932501460 0 0) 0x7ff658074240 con 0x7ff6580b1390 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.216+0000 7ff65cc00640 1 --2- 172.21.15.5:0/1951553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b4940 0x7ff6580721e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff648009e50 tx=0x7ff64802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390719c91e404e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.217+0000 7ff657e00640 1 -- 172.21.15.5:0/1951553697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648036070 con 0x7ff6580b4940 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.217+0000 7ff657e00640 1 -- 172.21.15.5:0/1951553697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff648031600 con 0x7ff6580b4940 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.217+0000 7ff657e00640 1 -- 172.21.15.5:0/1951553697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480319d0 con 0x7ff6580b4940 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.217+0000 7ff660000640 1 -- 172.21.15.5:0/1951553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b4940 msgr2=0x7ff6580721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.217+0000 7ff660000640 1 --2- 172.21.15.5:0/1951553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b4940 0x7ff6580721e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff648009e50 tx=0x7ff64802a680 comp rx=0 tx=0).stop 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.218+0000 7ff660000640 1 -- 172.21.15.5:0/1951553697 shutdown_connections 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.218+0000 7ff660000640 1 --2- 172.21.15.5:0/1951553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b4940 0x7ff6580721e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.218+0000 7ff660000640 1 --2- 172.21.15.5:0/1951553697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff658071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.218+0000 7ff660000640 1 -- 172.21.15.5:0/1951553697 >> 172.21.15.5:0/1951553697 conn(0x7ff6580b8c30 msgr2=0x7ff6580b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.218+0000 7ff660000640 1 -- 172.21.15.5:0/1951553697 shutdown_connections 2024-04-26T22:03:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.218+0000 7ff660000640 1 -- 172.21.15.5:0/1951553697 wait complete. 2024-04-26T22:03:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.219+0000 7ff660000640 1 Processor -- start 2024-04-26T22:03:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.219+0000 7ff660000640 1 -- start start 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.220+0000 7ff660000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff6581480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.220+0000 7ff660000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b1390 0x7ff6581dda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.220+0000 7ff660000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6580b4940 0x7ff6581ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.220+0000 7ff660000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff658142bb0 con 0x7ff6580b1390 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.220+0000 7ff660000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff658073c30 con 0x7ff6580b4940 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.220+0000 7ff660000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff658142d30 con 0x7ff6580a0010 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b1390 0x7ff6581dda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b1390 0x7ff6581dda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60890/0 (socket says 172.21.15.5:60890) 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 -- 172.21.15.5:0/3631254644 learned_addr learned my addr 172.21.15.5:0/3631254644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65d600640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff6581480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65e000640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6580b4940 0x7ff6581ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 -- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 msgr2=0x7ff6581480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff6581480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 -- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6580b4940 msgr2=0x7ff6581ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6580b4940 0x7ff6581ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 -- 172.21.15.5:0/3631254644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6581e15b0 con 0x7ff6580b1390 2024-04-26T22:03:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.221+0000 7ff65cc00640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b1390 0x7ff6581dda00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff648009e50 tx=0x7ff648004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.222+0000 7ff655600640 1 -- 172.21.15.5:0/3631254644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648041020 con 0x7ff6580b1390 2024-04-26T22:03:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.222+0000 7ff655600640 1 -- 172.21.15.5:0/3631254644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff648037040 con 0x7ff6580b1390 2024-04-26T22:03:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.222+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6581e1890 con 0x7ff6580b1390 2024-04-26T22:03:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.222+0000 7ff655600640 1 -- 172.21.15.5:0/3631254644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648036050 con 0x7ff6580b1390 2024-04-26T22:03:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.222+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6581d7ca0 con 0x7ff6580b1390 2024-04-26T22:03:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.223+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff658075db0 con 0x7ff6580b1390 2024-04-26T22:03:41.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.224+0000 7ff655600640 1 -- 172.21.15.5:0/3631254644 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff648007c50 con 0x7ff6580b1390 2024-04-26T22:03:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.225+0000 7ff655600640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff63c06c940 0x7ff63c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.226+0000 7ff655600640 1 -- 172.21.15.5:0/3631254644 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff6480ac720 con 0x7ff6580b1390 2024-04-26T22:03:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.226+0000 7ff65d600640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff63c06c940 0x7ff63c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.227+0000 7ff65d600640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff63c06c940 0x7ff63c06ee00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:41.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.230+0000 7ff655600640 1 -- 172.21.15.5:0/3631254644 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff64804b060 con 0x7ff6580b1390 2024-04-26T22:03:41.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.435+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff658148da0 con 0x7ff6580b1390 2024-04-26T22:03:41.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.436+0000 7ff655600640 1 -- 172.21.15.5:0/3631254644 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff64807a7c0 con 0x7ff6580b1390 2024-04-26T22:03:41.437 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff63c06c940 msgr2=0x7ff63c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff63c06c940 0x7ff63c06ee00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c008040 comp rx=0 tx=0).stop 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b1390 msgr2=0x7ff6581dda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b1390 0x7ff6581dda00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff648009e50 tx=0x7ff648004a40 comp rx=0 tx=0).stop 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 shutdown_connections 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6580b4940 0x7ff6581ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff63c06c940 0x7ff63c06ee00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6580b1390 0x7ff6581dda00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 --2- 172.21.15.5:0/3631254644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6580a0010 0x7ff6581480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 >> 172.21.15.5:0/3631254644 conn(0x7ff6580b8c30 msgr2=0x7ff6581414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:41.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 shutdown_connections 2024-04-26T22:03:41.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.440+0000 7ff660000640 1 -- 172.21.15.5:0/3631254644 wait complete. 2024-04-26T22:03:41.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:03:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.673+0000 7f59e3000640 1 Processor -- start 2024-04-26T22:03:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.673+0000 7f59e3000640 1 -- start start 2024-04-26T22:03:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.675+0000 7f59e3000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59dc0be750 0x7f59dc0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.675+0000 7f59e3000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc0beb30 con 0x7f59dc0ba450 2024-04-26T22:03:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.675+0000 7f59e3000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc0b5630 con 0x7f59dc14c120 2024-04-26T22:03:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.675+0000 7f59e3000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f59dc0b5c80 con 0x7f59dc0be750 2024-04-26T22:03:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.675+0000 7f59e1200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f59dc0ba450 0x7f59dc14ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46976/0 (socket says 172.21.15.5:46976) 2024-04-26T22:03:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.675+0000 7f59e1200640 1 -- 172.21.15.5:0/200090620 learned_addr learned my addr 172.21.15.5:0/200090620 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.675+0000 7f59e1c00640 1 --2- 172.21.15.5:0/200090620 >> v2:172.21.15.5:3300/0 conn(0x7f59dc0be750 0x7f59dc0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.676+0000 7f59dbe00640 1 -- 172.21.15.5:0/200090620 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150104256 0 0) 0x7f59dc0beb30 con 0x7f59dc0ba450 2024-04-26T22:03:41.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.676+0000 7f59dbe00640 1 -- 172.21.15.5:0/200090620 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c4003520 con 0x7f59dc0ba450 2024-04-26T22:03:41.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.676+0000 7f59e1c00640 1 -- 172.21.15.5:0/200090620 >> v1:172.21.15.112:6789/0 conn(0x7f59dc14c120 legacy=0x7f59dc1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.676+0000 7f59e1c00640 1 -- 172.21.15.5:0/200090620 >> v1:172.21.15.5:6789/0 conn(0x7f59dc0ba450 legacy=0x7f59dc14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.676+0000 7f59e1c00640 1 -- 172.21.15.5:0/200090620 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0b5910 con 0x7f59dc0be750 2024-04-26T22:03:41.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.677+0000 7f59e1c00640 1 --2- 172.21.15.5:0/200090620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc0b69b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f59d00097a0 tx=0x7f59d002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ac8932ee181cff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:41.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.677+0000 7f59dbe00640 1 -- 172.21.15.5:0/200090620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0037070 con 0x7f59dc0be750 2024-04-26T22:03:41.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.677+0000 7f59dbe00640 1 -- 172.21.15.5:0/200090620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d0032440 con 0x7f59dc0be750 2024-04-26T22:03:41.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.677+0000 7f59dbe00640 1 -- 172.21.15.5:0/200090620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00327f0 con 0x7f59dc0be750 2024-04-26T22:03:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.678+0000 7f59e3000640 1 -- 172.21.15.5:0/200090620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 msgr2=0x7f59dc0b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.678+0000 7f59e3000640 1 --2- 172.21.15.5:0/200090620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc0b69b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f59d00097a0 tx=0x7f59d002a230 comp rx=0 tx=0).stop 2024-04-26T22:03:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.678+0000 7f59e3000640 1 -- 172.21.15.5:0/200090620 shutdown_connections 2024-04-26T22:03:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.678+0000 7f59e3000640 1 --2- 172.21.15.5:0/200090620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc0b69b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.678+0000 7f59e3000640 1 -- 172.21.15.5:0/200090620 >> 172.21.15.5:0/200090620 conn(0x7f59dc0686c0 msgr2=0x7f59dc0bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.678+0000 7f59e3000640 1 -- 172.21.15.5:0/200090620 shutdown_connections 2024-04-26T22:03:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.678+0000 7f59e3000640 1 -- 172.21.15.5:0/200090620 wait complete. 2024-04-26T22:03:41.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.679+0000 7f59e3000640 1 Processor -- start 2024-04-26T22:03:41.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.680+0000 7f59e3000640 1 -- start start 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.680+0000 7f59e3000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59dc0ba450 0x7f59dc13aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.680+0000 7f59e3000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.680+0000 7f59e3000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59dc14c120 0x7f59dc1394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.680+0000 7f59e3000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc153db0 con 0x7f59dc0be750 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.680+0000 7f59e3000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc142a90 con 0x7f59dc0ba450 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.680+0000 7f59e3000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc153f30 con 0x7f59dc14c120 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60902/0 (socket says 172.21.15.5:60902) 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 -- 172.21.15.5:0/3372482996 learned_addr learned my addr 172.21.15.5:0/3372482996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e2600640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59dc14c120 0x7f59dc1394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1c00640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59dc0ba450 0x7f59dc13aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 -- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59dc14c120 msgr2=0x7f59dc1394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59dc14c120 0x7f59dc1394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 -- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59dc0ba450 msgr2=0x7f59dc13aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59dc0ba450 0x7f59dc13aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.681+0000 7f59e1200640 1 -- 172.21.15.5:0/3372482996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc1e11c0 con 0x7f59dc0be750 2024-04-26T22:03:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.682+0000 7f59e1200640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc147650 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f59c800c500 tx=0x7f59c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.682+0000 7f59d9600640 1 -- 172.21.15.5:0/3372482996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8017070 con 0x7f59dc0be750 2024-04-26T22:03:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.682+0000 7f59d9600640 1 -- 172.21.15.5:0/3372482996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c8005ce0 con 0x7f59dc0be750 2024-04-26T22:03:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.682+0000 7f59d9600640 1 -- 172.21.15.5:0/3372482996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8007330 con 0x7f59dc0be750 2024-04-26T22:03:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.682+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc1e14a0 con 0x7f59dc0be750 2024-04-26T22:03:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.682+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc1e1a60 con 0x7f59dc0be750 2024-04-26T22:03:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.683+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc075db0 con 0x7f59dc0be750 2024-04-26T22:03:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.684+0000 7f59d9600640 1 -- 172.21.15.5:0/3372482996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59c801a070 con 0x7f59dc0be750 2024-04-26T22:03:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.685+0000 7f59d9600640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f59bc06c920 0x7f59bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.685+0000 7f59d9600640 1 -- 172.21.15.5:0/3372482996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f59c808b3e0 con 0x7f59dc0be750 2024-04-26T22:03:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.686+0000 7f59e1c00640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f59bc06c920 0x7f59bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:41.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.687+0000 7f59e1c00640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f59bc06c920 0x7f59bc06ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f59d0034000 tx=0x7f59d002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.690+0000 7f59d9600640 1 -- 172.21.15.5:0/3372482996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f59c80594c0 con 0x7f59dc0be750 2024-04-26T22:03:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.892+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f59dc1485c0 con 0x7f59dc0be750 2024-04-26T22:03:41.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.893+0000 7f59d9600640 1 -- 172.21.15.5:0/3372482996 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f59c8058dc0 con 0x7f59dc0be750 2024-04-26T22:03:41.894 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-26T22:03:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f59bc06c920 msgr2=0x7f59bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f59bc06c920 0x7f59bc06ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f59d0034000 tx=0x7f59d002e000 comp rx=0 tx=0).stop 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 msgr2=0x7f59dc147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc147650 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f59c800c500 tx=0x7f59c800c9c0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 shutdown_connections 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59dc14c120 0x7f59dc1394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f59bc06c920 0x7f59bc06ede0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59dc0be750 0x7f59dc147650 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 --2- 172.21.15.5:0/3372482996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59dc0ba450 0x7f59dc13aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 >> 172.21.15.5:0/3372482996 conn(0x7f59dc0686c0 msgr2=0x7f59dc141170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 shutdown_connections 2024-04-26T22:03:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:41.896+0000 7f59e3000640 1 -- 172.21.15.5:0/3372482996 wait complete. 2024-04-26T22:03:41.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T22:03:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.133+0000 7f2cc6a00640 1 Processor -- start 2024-04-26T22:03:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.133+0000 7f2cc6a00640 1 -- start start 2024-04-26T22:03:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.134+0000 7f2cc6a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2cc00b6d50 0x7f2cc0145300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.134+0000 7f2cc6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc00b3710 0x7f2cc013f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.134+0000 7f2cc6a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc00b7130 con 0x7f2cc013f6c0 2024-04-26T22:03:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.134+0000 7f2cc6a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc00b2cc0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.134+0000 7f2cc6a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc00b2f10 con 0x7f2cc00b3710 2024-04-26T22:03:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.135+0000 7f2cc6000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2cc013f6c0 0x7f2cc0148870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46992/0 (socket says 172.21.15.5:46992) 2024-04-26T22:03:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.135+0000 7f2cc6000640 1 -- 172.21.15.5:0/1711031855 learned_addr learned my addr 172.21.15.5:0/1711031855 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.135+0000 7f2cc5600640 1 --2- 172.21.15.5:0/1711031855 >> v2:172.21.15.112:3300/0 conn(0x7f2cc00b6d50 0x7f2cc0145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.135+0000 7f2cc4c00640 1 --2- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc00b3710 0x7f2cc013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.135+0000 7f2cbfe00640 1 -- 172.21.15.5:0/1711031855 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415421910 0 0) 0x7f2cc00b7130 con 0x7f2cc013f6c0 2024-04-26T22:03:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.135+0000 7f2cbfe00640 1 -- 172.21.15.5:0/1711031855 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca8003520 con 0x7f2cc013f6c0 2024-04-26T22:03:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.136+0000 7f2cc5600640 1 -- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc00b3710 msgr2=0x7f2cc013f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.136+0000 7f2cc5600640 1 --2- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc00b3710 0x7f2cc013f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.136+0000 7f2cbfe00640 1 -- 172.21.15.5:0/1711031855 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1100812005 0 0) 0x7f2ca8003520 con 0x7f2cc013f6c0 2024-04-26T22:03:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.136+0000 7f2cc5600640 1 -- 172.21.15.5:0/1711031855 >> v1:172.21.15.5:6789/0 conn(0x7f2cc013f6c0 legacy=0x7f2cc0148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.136+0000 7f2cc5600640 1 -- 172.21.15.5:0/1711031855 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc00b31f0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.137+0000 7f2cc5600640 1 --2- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0145300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097a0 tx=0x7f2cb002c210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ac7d6eb00f7edb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.138+0000 7f2cbfe00640 1 -- 172.21.15.5:0/1711031855 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0039070 con 0x7f2cc00b6d50 2024-04-26T22:03:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.138+0000 7f2cbfe00640 1 -- 172.21.15.5:0/1711031855 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb002cca0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.138+0000 7f2cbfe00640 1 -- 172.21.15.5:0/1711031855 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80019f0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b6d50 msgr2=0x7f2cc0145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0145300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097a0 tx=0x7f2cb002c210 comp rx=0 tx=0).stop 2024-04-26T22:03:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1711031855 shutdown_connections 2024-04-26T22:03:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc00b3710 0x7f2cc013f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1711031855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0145300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1711031855 >> 172.21.15.5:0/1711031855 conn(0x7f2cc006c720 msgr2=0x7f2cc006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1711031855 shutdown_connections 2024-04-26T22:03:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.139+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1711031855 wait complete. 2024-04-26T22:03:42.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.141+0000 7f2cc6a00640 1 Processor -- start 2024-04-26T22:03:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.141+0000 7f2cc6a00640 1 -- start start 2024-04-26T22:03:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.142+0000 7f2cc6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b3710 0x7f2cc0072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.142+0000 7f2cc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.142+0000 7f2cc6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc013f6c0 0x7f2cc0071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.142+0000 7f2cc6a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0145840 con 0x7f2cc00b6d50 2024-04-26T22:03:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.142+0000 7f2cc6a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc00b6410 con 0x7f2cc00b3710 2024-04-26T22:03:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.142+0000 7f2cc6a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc00b0b40 con 0x7f2cc013f6c0 2024-04-26T22:03:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60912/0 (socket says 172.21.15.5:60912) 2024-04-26T22:03:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 -- 172.21.15.5:0/1735384598 learned_addr learned my addr 172.21.15.5:0/1735384598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc5600640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b3710 0x7f2cc0072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc6000640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc013f6c0 0x7f2cc0071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 -- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc013f6c0 msgr2=0x7f2cc0071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc013f6c0 0x7f2cc0071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 -- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b3710 msgr2=0x7f2cc0072ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b3710 0x7f2cc0072ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.143+0000 7f2cc4c00640 1 -- 172.21.15.5:0/1735384598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc0073df0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.144+0000 7f2cc4c00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0143170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e870 tx=0x7f2cb400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.144+0000 7f2cbd600640 1 -- 172.21.15.5:0/1735384598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4017070 con 0x7f2cc00b6d50 2024-04-26T22:03:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.144+0000 7f2cbd600640 1 -- 172.21.15.5:0/1735384598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb400c940 con 0x7f2cc00b6d50 2024-04-26T22:03:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.144+0000 7f2cbd600640 1 -- 172.21.15.5:0/1735384598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400cd30 con 0x7f2cc00b6d50 2024-04-26T22:03:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.144+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc01e11b0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.144+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc01436b0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.145+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc0075db0 con 0x7f2cc00b6d50 2024-04-26T22:03:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.146+0000 7f2cbd600640 1 -- 172.21.15.5:0/1735384598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cb401a070 con 0x7f2cc00b6d50 2024-04-26T22:03:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.148+0000 7f2cbd600640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2ca406c920 0x7f2ca406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.149+0000 7f2cbd600640 1 -- 172.21.15.5:0/1735384598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2cb408c160 con 0x7f2cc00b6d50 2024-04-26T22:03:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.149+0000 7f2cc5600640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2ca406c920 0x7f2ca406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.150+0000 7f2cc5600640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2ca406c920 0x7f2ca406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0036000 tx=0x7f2cb0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.153+0000 7f2cbd600640 1 -- 172.21.15.5:0/1735384598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2cb405a180 con 0x7f2cc00b6d50 2024-04-26T22:03:42.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.361+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2cc0068a50 con 0x7f2cc00b6d50 2024-04-26T22:03:42.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.362+0000 7f2cbd600640 1 -- 172.21.15.5:0/1735384598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f2cb4059a80 con 0x7f2cc00b6d50 2024-04-26T22:03:42.363 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-26T22:03:42.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2ca406c920 msgr2=0x7f2ca406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2ca406c920 0x7f2ca406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0036000 tx=0x7f2cb0030000 comp rx=0 tx=0).stop 2024-04-26T22:03:42.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc00b6d50 msgr2=0x7f2cc0143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0143170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e870 tx=0x7f2cb400ed30 comp rx=0 tx=0).stop 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 shutdown_connections 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2cc013f6c0 0x7f2cc0071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2ca406c920 0x7f2ca406ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc00b6d50 0x7f2cc0143170 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 --2- 172.21.15.5:0/1735384598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cc00b3710 0x7f2cc0072ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 >> 172.21.15.5:0/1735384598 conn(0x7f2cc006c720 msgr2=0x7f2cc013c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.365+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 shutdown_connections 2024-04-26T22:03:42.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.366+0000 7f2cc6a00640 1 -- 172.21.15.5:0/1735384598 wait complete. 2024-04-26T22:03:42.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:03:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.596+0000 7f11d3000640 1 Processor -- start 2024-04-26T22:03:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.596+0000 7f11d3000640 1 -- start start 2024-04-26T22:03:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d3000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 0x7f11cc0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d3000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f11cc142310 0x7f11cc142770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d3000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11cc0bb260 con 0x7f11cc148600 2024-04-26T22:03:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d3000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc0b6270 con 0x7f11cc142310 2024-04-26T22:03:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d3000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc0b6550 con 0x7f11cc0bae80 2024-04-26T22:03:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d2600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f11cc148600 0x7f11cc148a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46998/0 (socket says 172.21.15.5:46998) 2024-04-26T22:03:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d2600640 1 -- 172.21.15.5:0/1658263681 learned_addr learned my addr 172.21.15.5:0/1658263681 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.598+0000 7f11d1c00640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 0x7f11cc0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11d1200640 1 --2- 172.21.15.5:0/1658263681 >> v2:172.21.15.112:3300/0 conn(0x7f11cc142310 0x7f11cc142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018331871 0 0) 0x7f11cc0bb260 con 0x7f11cc148600 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11b4003520 con 0x7f11cc148600 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103778633 0 0) 0x7f11b4003520 con 0x7f11cc148600 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 msgr2=0x7f11cc0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 0x7f11cc0b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 >> v2:172.21.15.112:3300/0 conn(0x7f11cc142310 msgr2=0x7f11cc142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 --2- 172.21.15.5:0/1658263681 >> v2:172.21.15.112:3300/0 conn(0x7f11cc142310 0x7f11cc142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc0b6830 con 0x7f11cc148600 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f11c40019f0 con 0x7f11cc148600 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 >> v1:172.21.15.5:6789/0 conn(0x7f11cc148600 legacy=0x7f11cc148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 0x7f11b40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11b4003f30 0x7f11b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4004d40 0x7f11b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0b6270 con 0x7f11b4003f30 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0b6550 con 0x7f11b4004d40 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.599+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f11b400ba10 con 0x7f11cc0bae80 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d1200640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11b4003f30 0x7f11b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d1c00640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 0x7f11b40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d2600640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4004d40 0x7f11b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d1200640 1 -- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 msgr2=0x7f11b40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d1200640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc0bae80 0x7f11b40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d1200640 1 -- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4004d40 msgr2=0x7f11b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d1200640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4004d40 0x7f11b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.600+0000 7f11d1200640 1 -- 172.21.15.5:0/1658263681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b4003520 con 0x7f11b4003f30 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.601+0000 7f11d1200640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11b4003f30 0x7f11b4004800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009af0 tx=0x7f11b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae00e702c27bcde5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.601+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8036070 con 0x7f11b4003f30 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.601+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8031400 con 0x7f11b4003f30 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.601+0000 7f11cbe00640 1 -- 172.21.15.5:0/1658263681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8009690 con 0x7f11b4003f30 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.602+0000 7f11d3000640 1 -- 172.21.15.5:0/1658263681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11b4003f30 msgr2=0x7f11b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.602+0000 7f11d3000640 1 --2- 172.21.15.5:0/1658263681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11b4003f30 0x7f11b4004800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009af0 tx=0x7f11b4005830 comp rx=0 tx=0).stop 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.602+0000 7f11d2600640 1 -- 172.21.15.5:0/1658263681 reap_dead start 2024-04-26T22:03:42.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.602+0000 7f11d3000640 1 -- 172.21.15.5:0/1658263681 shutdown_connections 2024-04-26T22:03:42.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.602+0000 7f11d3000640 1 -- 172.21.15.5:0/1658263681 >> 172.21.15.5:0/1658263681 conn(0x7f11cc0684b0 msgr2=0x7f11cc0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:42.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.602+0000 7f11d3000640 1 -- 172.21.15.5:0/1658263681 shutdown_connections 2024-04-26T22:03:42.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.602+0000 7f11d3000640 1 -- 172.21.15.5:0/1658263681 wait complete. 2024-04-26T22:03:42.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.604+0000 7f11d3000640 1 Processor -- start 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.604+0000 7f11d3000640 1 -- start start 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d3000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4003f30 0x7f11cc1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d3000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc1ddc50 0x7f11cc1de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d3000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11cc0b3f40 0x7f11cc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d3000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0b57d0 con 0x7f11cc0b3f40 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d3000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0ba3a0 con 0x7f11b4003f30 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d3000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc0b5950 con 0x7f11cc1ddc50 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d2600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11cc0b3f40 0x7f11cc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d2600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11cc0b3f40 0x7f11cc0b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60920/0 (socket says 172.21.15.5:60920) 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.605+0000 7f11d2600640 1 -- 172.21.15.5:0/1454038729 learned_addr learned my addr 172.21.15.5:0/1454038729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d1200640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc1ddc50 0x7f11cc1de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d1c00640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4003f30 0x7f11cc1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d2600640 1 -- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc1ddc50 msgr2=0x7f11cc1de0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d2600640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc1ddc50 0x7f11cc1de0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d2600640 1 -- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4003f30 msgr2=0x7f11cc1454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d2600640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4003f30 0x7f11cc1454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d2600640 1 -- 172.21.15.5:0/1454038729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc1de610 con 0x7f11cc0b3f40 2024-04-26T22:03:42.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11d2600640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11cc0b3f40 0x7f11cc0b43c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f11c4000f80 tx=0x7f11c400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.606+0000 7f11c9600640 1 -- 172.21.15.5:0/1454038729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c400ee20 con 0x7f11cc0b3f40 2024-04-26T22:03:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.607+0000 7f11c9600640 1 -- 172.21.15.5:0/1454038729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c4014430 con 0x7f11cc0b3f40 2024-04-26T22:03:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.607+0000 7f11c9600640 1 -- 172.21.15.5:0/1454038729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4014820 con 0x7f11cc0b3f40 2024-04-26T22:03:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.607+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11cc0b4900 con 0x7f11cc0b3f40 2024-04-26T22:03:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.607+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11cc0ab290 con 0x7f11cc0b3f40 2024-04-26T22:03:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.608+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11cc075db0 con 0x7f11cc0b3f40 2024-04-26T22:03:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.609+0000 7f11c9600640 1 -- 172.21.15.5:0/1454038729 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f11c40149c0 con 0x7f11cc0b3f40 2024-04-26T22:03:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.610+0000 7f11c9600640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f11ac06c8f0 0x7f11ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.610+0000 7f11c9600640 1 -- 172.21.15.5:0/1454038729 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f11c408bf30 con 0x7f11cc0b3f40 2024-04-26T22:03:42.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.611+0000 7f11d1c00640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f11ac06c8f0 0x7f11ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:42.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.612+0000 7f11d1c00640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f11ac06c8f0 0x7f11ac06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11cc144d20 tx=0x7f11c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.615+0000 7f11c9600640 1 -- 172.21.15.5:0/1454038729 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f11cc1de610 con 0x7f11cc0b3f40 2024-04-26T22:03:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.833+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f11cc0b9a20 con 0x7f11cc0b3f40 2024-04-26T22:03:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.833+0000 7f11c9600640 1 -- 172.21.15.5:0/1454038729 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f11c4059ec0 con 0x7f11cc0b3f40 2024-04-26T22:03:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-26T22:03:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f11ac06c8f0 msgr2=0x7f11ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f11ac06c8f0 0x7f11ac06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11cc144d20 tx=0x7f11c0008040 comp rx=0 tx=0).stop 2024-04-26T22:03:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11cc0b3f40 msgr2=0x7f11cc0b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11cc0b3f40 0x7f11cc0b43c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f11c4000f80 tx=0x7f11c400e530 comp rx=0 tx=0).stop 2024-04-26T22:03:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 shutdown_connections 2024-04-26T22:03:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f11ac06c8f0 0x7f11ac06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11cc0b3f40 0x7f11cc0b43c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11cc1ddc50 0x7f11cc1de0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 --2- 172.21.15.5:0/1454038729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11b4003f30 0x7f11cc1454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.836+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 >> 172.21.15.5:0/1454038729 conn(0x7f11cc0684b0 msgr2=0x7f11cc13f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.838+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 shutdown_connections 2024-04-26T22:03:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:42.838+0000 7f11d3000640 1 -- 172.21.15.5:0/1454038729 wait complete. 2024-04-26T22:03:42.856 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-04-26T22:03:42.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:42.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T22:03:42.938 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:03:42.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[41727]: fuse finished with error 0 and tester_r 0 2024-04-26T22:03:49.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T22:03:49.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:49.041 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:03:49.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:49.110 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-26T22:03:49.206 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:03:49.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:49.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:03:49.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:49.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-26T22:03:49.405 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T22:03:49.415 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T22:03:49.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:03:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.614+0000 7f1952a00640 1 Processor -- start 2024-04-26T22:03:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.614+0000 7f1952a00640 1 -- start start 2024-04-26T22:03:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.615+0000 7f1952a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 0x7f194c0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.615+0000 7f1952a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194c072bc0 con 0x7f194c1423a0 2024-04-26T22:03:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.615+0000 7f1952a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194c0b6d90 con 0x7f194c073c10 2024-04-26T22:03:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.615+0000 7f1952a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f194c0bae10 con 0x7f194c071940 2024-04-26T22:03:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.616+0000 7f1943400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f194c1423a0 0x7f194c073500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48460/0 (socket says 172.21.15.5:48460) 2024-04-26T22:03:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.616+0000 7f1943400640 1 -- 172.21.15.5:0/3026019694 learned_addr learned my addr 172.21.15.5:0/3026019694 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.616+0000 7f194be00640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 0x7f194c0b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.616+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596641160 0 0) 0x7f194c072bc0 con 0x7f194c1423a0 2024-04-26T22:03:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.616+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1930003520 con 0x7f194c1423a0 2024-04-26T22:03:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1339377571 0 0) 0x7f1930003520 con 0x7f194c1423a0 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 msgr2=0x7f194c0b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 0x7f194c0b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 >> v1:172.21.15.112:6789/0 conn(0x7f194c073c10 legacy=0x7f194c152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c0bb0f0 con 0x7f194c1423a0 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f1934001670 con 0x7f194c1423a0 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 >> v1:172.21.15.5:6789/0 conn(0x7f194c1423a0 legacy=0x7f194c073500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19300039e0 0x7f1930003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1930004390 0x7f1930004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 0x7f1930005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f194c0bae10 con 0x7f19300039e0 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f193000ba70 con 0x7f1930004390 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f193000bc70 con 0x7f194c071940 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194be00640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19300039e0 0x7f1930003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f1943400640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1930004390 0x7f1930004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f1950a00640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 0x7f1930005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.617+0000 7f194be00640 1 -- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 msgr2=0x7f1930005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.618+0000 7f194be00640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c071940 0x7f1930005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.618+0000 7f194be00640 1 -- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1930004390 msgr2=0x7f1930004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.618+0000 7f194be00640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1930004390 0x7f1930004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.618+0000 7f194be00640 1 -- 172.21.15.5:0/3026019694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1930003520 con 0x7f19300039e0 2024-04-26T22:03:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.618+0000 7f1943400640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1930004390 0x7f1930004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.619+0000 7f194be00640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19300039e0 0x7f1930003dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f193c009fc0 tx=0x7f1930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb65d23246016783 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.619+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c009c10 con 0x7f19300039e0 2024-04-26T22:03:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.619+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c036070 con 0x7f19300039e0 2024-04-26T22:03:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.619+0000 7f194b400640 1 -- 172.21.15.5:0/3026019694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c031880 con 0x7f19300039e0 2024-04-26T22:03:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.619+0000 7f1952a00640 1 -- 172.21.15.5:0/3026019694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19300039e0 msgr2=0x7f1930003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.619+0000 7f1952a00640 1 --2- 172.21.15.5:0/3026019694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19300039e0 0x7f1930003dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f193c009fc0 tx=0x7f1930005830 comp rx=0 tx=0).stop 2024-04-26T22:03:49.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.619+0000 7f1950a00640 1 -- 172.21.15.5:0/3026019694 reap_dead start 2024-04-26T22:03:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.620+0000 7f1952a00640 1 -- 172.21.15.5:0/3026019694 shutdown_connections 2024-04-26T22:03:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.620+0000 7f1952a00640 1 -- 172.21.15.5:0/3026019694 >> 172.21.15.5:0/3026019694 conn(0x7f194c06d5f0 msgr2=0x7f194c06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.620+0000 7f1952a00640 1 -- 172.21.15.5:0/3026019694 shutdown_connections 2024-04-26T22:03:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.620+0000 7f1952a00640 1 -- 172.21.15.5:0/3026019694 wait complete. 2024-04-26T22:03:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.621+0000 7f1952a00640 1 Processor -- start 2024-04-26T22:03:49.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.622+0000 7f1952a00640 1 -- start start 2024-04-26T22:03:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.622+0000 7f1952a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19300039e0 0x7f194c1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.622+0000 7f1952a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c1ddd30 0x7f194c1de190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.622+0000 7f1952a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f194c1e12a0 0x7f194c1e1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.622+0000 7f1952a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f194c142800 con 0x7f194c1e12a0 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.622+0000 7f1952a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f194c071d20 con 0x7f19300039e0 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.622+0000 7f1952a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f194c142980 con 0x7f194c1ddd30 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f194c1e12a0 0x7f194c1e1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f194c1e12a0 0x7f194c1e1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34164/0 (socket says 172.21.15.5:34164) 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 -- 172.21.15.5:0/2737851268 learned_addr learned my addr 172.21.15.5:0/2737851268 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1943400640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c1ddd30 0x7f194c1de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f194be00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19300039e0 0x7f194c1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 -- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c1ddd30 msgr2=0x7f194c1de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c1ddd30 0x7f194c1de190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 -- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19300039e0 msgr2=0x7f194c1410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19300039e0 0x7f194c1410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.623+0000 7f1950a00640 1 -- 172.21.15.5:0/2737851268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c0b2150 con 0x7f194c1e12a0 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.624+0000 7f1950a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f194c1e12a0 0x7f194c1e1720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f194c0b5c60 tx=0x7f194400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:49.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.624+0000 7f1948c00640 1 -- 172.21.15.5:0/2737851268 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1944018070 con 0x7f194c1e12a0 2024-04-26T22:03:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.624+0000 7f1948c00640 1 -- 172.21.15.5:0/2737851268 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19440035f0 con 0x7f194c1e12a0 2024-04-26T22:03:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.624+0000 7f1948c00640 1 -- 172.21.15.5:0/2737851268 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440039e0 con 0x7f194c1e12a0 2024-04-26T22:03:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.624+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194c0b31c0 con 0x7f194c1e12a0 2024-04-26T22:03:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.624+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f194c1de6d0 con 0x7f194c1e12a0 2024-04-26T22:03:49.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.625+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194c075db0 con 0x7f194c1e12a0 2024-04-26T22:03:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.627+0000 7f1948c00640 1 -- 172.21.15.5:0/2737851268 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f194401b070 con 0x7f194c1e12a0 2024-04-26T22:03:49.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.628+0000 7f1948c00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f192806c8f0 0x7f192806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:49.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.628+0000 7f1948c00640 1 -- 172.21.15.5:0/2737851268 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f194408b490 con 0x7f194c1e12a0 2024-04-26T22:03:49.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.629+0000 7f194be00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f192806c8f0 0x7f192806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:49.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.630+0000 7f194be00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f192806c8f0 0x7f192806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f193c035000 tx=0x7f193c02f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:49.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.634+0000 7f1948c00640 1 -- 172.21.15.5:0/2737851268 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f19440594b0 con 0x7f194c1e12a0 2024-04-26T22:03:49.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.837+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f194c146790 con 0x7f192806c8f0 2024-04-26T22:03:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.871+0000 7f1948c00640 1 -- 172.21.15.5:0/2737851268 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334763 (secure 0 0 0) 0x7f194c146790 con 0x7f192806c8f0 2024-04-26T22:03:49.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:03:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T22:03:49.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f192806c8f0 msgr2=0x7f192806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:49.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f192806c8f0 0x7f192806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f193c035000 tx=0x7f193c02f000 comp rx=0 tx=0).stop 2024-04-26T22:03:49.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f194c1e12a0 msgr2=0x7f194c1e1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f194c1e12a0 0x7f194c1e1720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f194c0b5c60 tx=0x7f194400d890 comp rx=0 tx=0).stop 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 shutdown_connections 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f192806c8f0 0x7f192806edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f194c1e12a0 0x7f194c1e1720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f194c1ddd30 0x7f194c1de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 --2- 172.21.15.5:0/2737851268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19300039e0 0x7f194c1410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 >> 172.21.15.5:0/2737851268 conn(0x7f194c06d5f0 msgr2=0x7f194c13f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 shutdown_connections 2024-04-26T22:03:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:49.877+0000 7f1952a00640 1 -- 172.21.15.5:0/2737851268 wait complete. 2024-04-26T22:03:49.898 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":821,"stamp":"2024-04-26T22:03:48.097175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240750948,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2795,"num_read_kb":5345,"num_write":112475,"num_write_kb":2515070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155951,"ondisk_log_size":155951,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2512264,"kb_used_data":472456,"kb_used_omap":12,"kb_used_meta":2039731,"kb_avail":752462456,"statfs":{"total":773094113280,"available":770521554944,"internally_reserved":0,"allocated":483794944,"data_stored":482416720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2088685108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-93607602,"num_objects":-644,"num_object_clones":0,"num_object_copies":-1874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-644,"num_whiteouts":0,"num_read":12,"num_read_kb":43,"num_write":692,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005902"},"pg_stats":[{"pgid":"2.1f","version":"26'1240","reported_seq":1278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.748279+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T22:03:37.748279+0000","last_peered":"2024-04-26T22:03:37.748279+0000","last_clean":"2024-04-26T22:03:37.748279+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T22:03:37.748279+0000","last_undegraded":"2024-04-26T22:03:37.748279+0000","last_fullsized":"2024-04-26T22:03:37.748279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:32.834699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'475","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032915+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T22:03:43.032915+0000","last_peered":"2024-04-26T22:03:43.032915+0000","last_clean":"2024-04-26T22:03:43.032915+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T22:03:43.032915+0000","last_undegraded":"2024-04-26T22:03:43.032915+0000","last_fullsized":"2024-04-26T22:03:43.032915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'1944","reported_seq":1972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.226697+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T22:03:35.226697+0000","last_peered":"2024-04-26T22:03:35.226697+0000","last_clean":"2024-04-26T22:03:35.226697+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T22:03:35.226697+0000","last_undegraded":"2024-04-26T22:03:35.226697+0000","last_fullsized":"2024-04-26T22:03:35.226697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1944,"log_dups_size":0,"ondisk_log_size":1944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":38072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3188","reported_seq":3227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746607+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T22:03:37.746607+0000","last_peered":"2024-04-26T22:03:37.746607+0000","last_clean":"2024-04-26T22:03:37.746607+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T22:03:37.746607+0000","last_undegraded":"2024-04-26T22:03:37.746607+0000","last_fullsized":"2024-04-26T22:03:37.746607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3196,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'472","reported_seq":508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.017603+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T22:03:43.017603+0000","last_peered":"2024-04-26T22:03:43.017603+0000","last_clean":"2024-04-26T22:03:43.017603+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T22:03:43.017603+0000","last_undegraded":"2024-04-26T22:03:43.017603+0000","last_fullsized":"2024-04-26T22:03:43.017603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2092","reported_seq":2120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194904+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T22:03:35.194904+0000","last_peered":"2024-04-26T22:03:35.194904+0000","last_clean":"2024-04-26T22:03:35.194904+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T22:03:35.194904+0000","last_undegraded":"2024-04-26T22:03:35.194904+0000","last_fullsized":"2024-04-26T22:03:35.194904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":42136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3681","reported_seq":3717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.754029+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T22:03:36.754029+0000","last_peered":"2024-04-26T22:03:36.754029+0000","last_clean":"2024-04-26T22:03:36.754029+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T22:03:36.754029+0000","last_undegraded":"2024-04-26T22:03:36.754029+0000","last_fullsized":"2024-04-26T22:03:36.754029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3687,"num_write_kb":30415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'531","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.040634+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T22:03:43.040634+0000","last_peered":"2024-04-26T22:03:43.040634+0000","last_clean":"2024-04-26T22:03:43.040634+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T22:03:43.040634+0000","last_undegraded":"2024-04-26T22:03:43.040634+0000","last_fullsized":"2024-04-26T22:03:43.040634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'2113","reported_seq":2148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.137495+0000","last_change":"2024-04-26T21:37:58.756041+0000","last_active":"2024-04-26T22:03:35.137495+0000","last_peered":"2024-04-26T22:03:35.137495+0000","last_clean":"2024-04-26T22:03:35.137495+0000","last_became_active":"2024-04-26T21:37:58.754696+0000","last_became_peered":"2024-04-26T21:37:58.754696+0000","last_unstale":"2024-04-26T22:03:35.137495+0000","last_undegraded":"2024-04-26T22:03:35.137495+0000","last_fullsized":"2024-04-26T22:03:35.137495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:14.032751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1612,"num_write_kb":85113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'411","reported_seq":447,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746921+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T22:03:36.746921+0000","last_peered":"2024-04-26T22:03:36.746921+0000","last_clean":"2024-04-26T22:03:36.746921+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T22:03:36.746921+0000","last_undegraded":"2024-04-26T22:03:36.746921+0000","last_fullsized":"2024-04-26T22:03:36.746921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039133+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T22:03:43.039133+0000","last_peered":"2024-04-26T22:03:43.039133+0000","last_clean":"2024-04-26T22:03:43.039133+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T22:03:43.039133+0000","last_undegraded":"2024-04-26T22:03:43.039133+0000","last_fullsized":"2024-04-26T22:03:43.039133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'2117","reported_seq":2145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233562+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T22:03:35.233562+0000","last_peered":"2024-04-26T22:03:35.233562+0000","last_clean":"2024-04-26T22:03:35.233562+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T22:03:35.233562+0000","last_undegraded":"2024-04-26T22:03:35.233562+0000","last_fullsized":"2024-04-26T22:03:35.233562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2117,"log_dups_size":0,"ondisk_log_size":2117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1631,"num_write_kb":60261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'502","reported_seq":538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043741+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T22:03:43.043741+0000","last_peered":"2024-04-26T22:03:43.043741+0000","last_clean":"2024-04-26T22:03:43.043741+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T22:03:43.043741+0000","last_undegraded":"2024-04-26T22:03:43.043741+0000","last_fullsized":"2024-04-26T22:03:43.043741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'2421","reported_seq":2458,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750510+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T22:03:37.750510+0000","last_peered":"2024-04-26T22:03:37.750510+0000","last_clean":"2024-04-26T22:03:37.750510+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T22:03:37.750510+0000","last_undegraded":"2024-04-26T22:03:37.750510+0000","last_fullsized":"2024-04-26T22:03:37.750510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2421,"log_dups_size":0,"ondisk_log_size":2421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":21667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'2164","reported_seq":2193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.113767+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T22:03:35.113767+0000","last_peered":"2024-04-26T22:03:35.113767+0000","last_clean":"2024-04-26T22:03:35.113767+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T22:03:35.113767+0000","last_undegraded":"2024-04-26T22:03:35.113767+0000","last_fullsized":"2024-04-26T22:03:35.113767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2164,"log_dups_size":0,"ondisk_log_size":2164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1702,"num_write_kb":82391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'487","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035776+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T22:03:43.035776+0000","last_peered":"2024-04-26T22:03:43.035776+0000","last_clean":"2024-04-26T22:03:43.035776+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T22:03:43.035776+0000","last_undegraded":"2024-04-26T22:03:43.035776+0000","last_fullsized":"2024-04-26T22:03:43.035776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'2546","reported_seq":2584,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744390+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T22:03:37.744390+0000","last_peered":"2024-04-26T22:03:37.744390+0000","last_clean":"2024-04-26T22:03:37.744390+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T22:03:37.744390+0000","last_undegraded":"2024-04-26T22:03:37.744390+0000","last_fullsized":"2024-04-26T22:03:37.744390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2556,"num_write_kb":21644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'2346","reported_seq":2375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.178720+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T22:03:35.178720+0000","last_peered":"2024-04-26T22:03:35.178720+0000","last_clean":"2024-04-26T22:03:35.178720+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T22:03:35.178720+0000","last_undegraded":"2024-04-26T22:03:35.178720+0000","last_fullsized":"2024-04-26T22:03:35.178720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2346,"log_dups_size":0,"ondisk_log_size":2346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1850,"num_write_kb":43022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'518","reported_seq":554,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032499+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T22:03:43.032499+0000","last_peered":"2024-04-26T22:03:43.032499+0000","last_clean":"2024-04-26T22:03:43.032499+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T22:03:43.032499+0000","last_undegraded":"2024-04-26T22:03:43.032499+0000","last_fullsized":"2024-04-26T22:03:43.032499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'925","reported_seq":963,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:19.800121+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T22:03:19.800121+0000","last_peered":"2024-04-26T22:03:19.800121+0000","last_clean":"2024-04-26T22:03:19.800121+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T22:03:19.800121+0000","last_undegraded":"2024-04-26T22:03:19.800121+0000","last_fullsized":"2024-04-26T22:03:19.800121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":8623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'2213","reported_seq":2242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.222029+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T22:03:35.222029+0000","last_peered":"2024-04-26T22:03:35.222029+0000","last_clean":"2024-04-26T22:03:35.222029+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T22:03:35.222029+0000","last_undegraded":"2024-04-26T22:03:35.222029+0000","last_fullsized":"2024-04-26T22:03:35.222029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2213,"log_dups_size":0,"ondisk_log_size":2213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":80555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.201419+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T22:03:35.201419+0000","last_peered":"2024-04-26T22:03:35.201419+0000","last_clean":"2024-04-26T22:03:35.201419+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T22:03:35.201419+0000","last_undegraded":"2024-04-26T22:03:35.201419+0000","last_fullsized":"2024-04-26T22:03:35.201419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'481","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746018+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T22:03:37.746018+0000","last_peered":"2024-04-26T22:03:37.746018+0000","last_clean":"2024-04-26T22:03:37.746018+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T22:03:37.746018+0000","last_undegraded":"2024-04-26T22:03:37.746018+0000","last_fullsized":"2024-04-26T22:03:37.746018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'1921","reported_seq":1950,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233522+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T22:03:35.233522+0000","last_peered":"2024-04-26T22:03:35.233522+0000","last_clean":"2024-04-26T22:03:35.233522+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T22:03:35.233522+0000","last_undegraded":"2024-04-26T22:03:35.233522+0000","last_fullsized":"2024-04-26T22:03:35.233522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'497","reported_seq":533,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031790+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T22:03:43.031790+0000","last_peered":"2024-04-26T22:03:43.031790+0000","last_clean":"2024-04-26T22:03:43.031790+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T22:03:43.031790+0000","last_undegraded":"2024-04-26T22:03:43.031790+0000","last_fullsized":"2024-04-26T22:03:43.031790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'397","reported_seq":435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.753663+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T22:03:37.753663+0000","last_peered":"2024-04-26T22:03:37.753663+0000","last_clean":"2024-04-26T22:03:37.753663+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T22:03:37.753663+0000","last_undegraded":"2024-04-26T22:03:37.753663+0000","last_fullsized":"2024-04-26T22:03:37.753663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'2230","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082241+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T22:03:35.082241+0000","last_peered":"2024-04-26T22:03:35.082241+0000","last_clean":"2024-04-26T22:03:35.082241+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T22:03:35.082241+0000","last_undegraded":"2024-04-26T22:03:35.082241+0000","last_fullsized":"2024-04-26T22:03:35.082241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2230,"log_dups_size":0,"ondisk_log_size":2230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":137897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'453","reported_seq":489,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049286+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T22:03:43.049286+0000","last_peered":"2024-04-26T22:03:43.049286+0000","last_clean":"2024-04-26T22:03:43.049286+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T22:03:43.049286+0000","last_undegraded":"2024-04-26T22:03:43.049286+0000","last_fullsized":"2024-04-26T22:03:43.049286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1574","reported_seq":1612,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.054439+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T22:03:43.054439+0000","last_peered":"2024-04-26T22:03:43.054439+0000","last_clean":"2024-04-26T22:03:43.054439+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T22:03:43.054439+0000","last_undegraded":"2024-04-26T22:03:43.054439+0000","last_fullsized":"2024-04-26T22:03:43.054439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1574,"log_dups_size":0,"ondisk_log_size":1574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899009,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4314,"num_write_kb":4514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'1970","reported_seq":2001,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227988+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T22:03:35.227988+0000","last_peered":"2024-04-26T22:03:35.227988+0000","last_clean":"2024-04-26T22:03:35.227988+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T22:03:35.227988+0000","last_undegraded":"2024-04-26T22:03:35.227988+0000","last_fullsized":"2024-04-26T22:03:35.227988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1970,"log_dups_size":0,"ondisk_log_size":1970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":39987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'506","reported_seq":542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.019974+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T22:03:43.019974+0000","last_peered":"2024-04-26T22:03:43.019974+0000","last_clean":"2024-04-26T22:03:43.019974+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T22:03:43.019974+0000","last_undegraded":"2024-04-26T22:03:43.019974+0000","last_fullsized":"2024-04-26T22:03:43.019974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2119","reported_seq":2157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748733+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T22:03:36.748733+0000","last_peered":"2024-04-26T22:03:36.748733+0000","last_clean":"2024-04-26T22:03:36.748733+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T22:03:36.748733+0000","last_undegraded":"2024-04-26T22:03:36.748733+0000","last_fullsized":"2024-04-26T22:03:36.748733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2119,"log_dups_size":0,"ondisk_log_size":2119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2125,"num_write_kb":17294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2154","reported_seq":2184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.006513+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T22:03:35.006513+0000","last_peered":"2024-04-26T22:03:35.006513+0000","last_clean":"2024-04-26T22:03:35.006513+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T22:03:35.006513+0000","last_undegraded":"2024-04-26T22:03:35.006513+0000","last_fullsized":"2024-04-26T22:03:35.006513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1661,"num_write_kb":51179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'504","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029821+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T22:03:43.029821+0000","last_peered":"2024-04-26T22:03:43.029821+0000","last_clean":"2024-04-26T22:03:43.029821+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T22:03:43.029821+0000","last_undegraded":"2024-04-26T22:03:43.029821+0000","last_fullsized":"2024-04-26T22:03:43.029821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'363","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.742937+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T22:03:37.742937+0000","last_peered":"2024-04-26T22:03:37.742937+0000","last_clean":"2024-04-26T22:03:37.742937+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T22:03:37.742937+0000","last_undegraded":"2024-04-26T22:03:37.742937+0000","last_fullsized":"2024-04-26T22:03:37.742937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'2388","reported_seq":2418,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.178286+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T22:03:35.178286+0000","last_peered":"2024-04-26T22:03:35.178286+0000","last_clean":"2024-04-26T22:03:35.178286+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T22:03:35.178286+0000","last_undegraded":"2024-04-26T22:03:35.178286+0000","last_fullsized":"2024-04-26T22:03:35.178286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2388,"log_dups_size":0,"ondisk_log_size":2388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":100197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035449+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T22:03:43.035449+0000","last_peered":"2024-04-26T22:03:43.035449+0000","last_clean":"2024-04-26T22:03:43.035449+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T22:03:43.035449+0000","last_undegraded":"2024-04-26T22:03:43.035449+0000","last_fullsized":"2024-04-26T22:03:43.035449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'2499","reported_seq":2537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746933+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T22:03:36.746933+0000","last_peered":"2024-04-26T22:03:36.746933+0000","last_clean":"2024-04-26T22:03:36.746933+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T22:03:36.746933+0000","last_undegraded":"2024-04-26T22:03:36.746933+0000","last_fullsized":"2024-04-26T22:03:36.746933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2499,"log_dups_size":0,"ondisk_log_size":2499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2501,"num_write_kb":21681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2296","reported_seq":2326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.238210+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T22:03:35.238210+0000","last_peered":"2024-04-26T22:03:35.238210+0000","last_clean":"2024-04-26T22:03:35.238210+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T22:03:35.238210+0000","last_undegraded":"2024-04-26T22:03:35.238210+0000","last_fullsized":"2024-04-26T22:03:35.238210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1815,"num_write_kb":51574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'506","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.021708+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T22:03:43.021708+0000","last_peered":"2024-04-26T22:03:43.021708+0000","last_clean":"2024-04-26T22:03:43.021708+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T22:03:43.021708+0000","last_undegraded":"2024-04-26T22:03:43.021708+0000","last_fullsized":"2024-04-26T22:03:43.021708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4043","reported_seq":6760,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.743148+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T22:03:43.743148+0000","last_peered":"2024-04-26T22:03:43.743148+0000","last_clean":"2024-04-26T22:03:43.743148+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T22:03:43.743148+0000","last_undegraded":"2024-04-26T22:03:43.743148+0000","last_fullsized":"2024-04-26T22:03:43.743148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15961989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":4049,"num_write_kb":18210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'1988","reported_seq":2018,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.245965+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T22:03:35.245965+0000","last_peered":"2024-04-26T22:03:35.245965+0000","last_clean":"2024-04-26T22:03:35.245965+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T22:03:35.245965+0000","last_undegraded":"2024-04-26T22:03:35.245965+0000","last_fullsized":"2024-04-26T22:03:35.245965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":88301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'487","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.040601+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T22:03:43.040601+0000","last_peered":"2024-04-26T22:03:43.040601+0000","last_clean":"2024-04-26T22:03:43.040601+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T22:03:43.040601+0000","last_undegraded":"2024-04-26T22:03:43.040601+0000","last_fullsized":"2024-04-26T22:03:43.040601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:03.104148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'2390","reported_seq":2429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746379+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T22:03:36.746379+0000","last_peered":"2024-04-26T22:03:36.746379+0000","last_clean":"2024-04-26T22:03:36.746379+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T22:03:36.746379+0000","last_undegraded":"2024-04-26T22:03:36.746379+0000","last_fullsized":"2024-04-26T22:03:36.746379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2392,"num_write_kb":17555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'2202","reported_seq":2232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.733322+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T22:03:35.733322+0000","last_peered":"2024-04-26T22:03:35.733322+0000","last_clean":"2024-04-26T22:03:35.733322+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T22:03:35.733322+0000","last_undegraded":"2024-04-26T22:03:35.733322+0000","last_fullsized":"2024-04-26T22:03:35.733322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":59602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'492","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031237+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T22:03:43.031237+0000","last_peered":"2024-04-26T22:03:43.031237+0000","last_clean":"2024-04-26T22:03:43.031237+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T22:03:43.031237+0000","last_undegraded":"2024-04-26T22:03:43.031237+0000","last_fullsized":"2024-04-26T22:03:43.031237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'937","reported_seq":975,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748385+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T22:03:36.748385+0000","last_peered":"2024-04-26T22:03:36.748385+0000","last_clean":"2024-04-26T22:03:36.748385+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T22:03:36.748385+0000","last_undegraded":"2024-04-26T22:03:36.748385+0000","last_fullsized":"2024-04-26T22:03:36.748385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:01:09.729938+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T22:01:09.729938+0000","last_peered":"2024-04-26T22:01:09.729938+0000","last_clean":"2024-04-26T22:01:09.729938+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T22:01:09.729938+0000","last_undegraded":"2024-04-26T22:01:09.729938+0000","last_fullsized":"2024-04-26T22:01:09.729938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2218","reported_seq":2248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186238+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T22:03:35.186238+0000","last_peered":"2024-04-26T22:03:35.186238+0000","last_clean":"2024-04-26T22:03:35.186238+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T22:03:35.186238+0000","last_undegraded":"2024-04-26T22:03:35.186238+0000","last_fullsized":"2024-04-26T22:03:35.186238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1718,"num_write_kb":49388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'483","reported_seq":518,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051569+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T22:03:43.051569+0000","last_peered":"2024-04-26T22:03:43.051569+0000","last_clean":"2024-04-26T22:03:43.051569+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T22:03:43.051569+0000","last_undegraded":"2024-04-26T22:03:43.051569+0000","last_fullsized":"2024-04-26T22:03:43.051569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'1337","reported_seq":1374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:14.287687+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T22:03:14.287687+0000","last_peered":"2024-04-26T22:03:14.287687+0000","last_clean":"2024-04-26T22:03:14.287687+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T22:03:14.287687+0000","last_undegraded":"2024-04-26T22:03:14.287687+0000","last_fullsized":"2024-04-26T22:03:14.287687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":12939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'2226","reported_seq":2256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082628+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T22:03:35.082628+0000","last_peered":"2024-04-26T22:03:35.082628+0000","last_clean":"2024-04-26T22:03:35.082628+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T22:03:35.082628+0000","last_undegraded":"2024-04-26T22:03:35.082628+0000","last_fullsized":"2024-04-26T22:03:35.082628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":82996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'526","reported_seq":561,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.034559+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T22:03:43.034559+0000","last_peered":"2024-04-26T22:03:43.034559+0000","last_clean":"2024-04-26T22:03:43.034559+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T22:03:43.034559+0000","last_undegraded":"2024-04-26T22:03:43.034559+0000","last_fullsized":"2024-04-26T22:03:43.034559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2771","reported_seq":2808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.725372+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T22:03:36.725372+0000","last_peered":"2024-04-26T22:03:36.725372+0000","last_clean":"2024-04-26T22:03:36.725372+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T22:03:36.725372+0000","last_undegraded":"2024-04-26T22:03:36.725372+0000","last_fullsized":"2024-04-26T22:03:36.725372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2771,"log_dups_size":0,"ondisk_log_size":2771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971590,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2774,"num_write_kb":25944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1964","reported_seq":1993,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:34.990272+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T22:03:34.990272+0000","last_peered":"2024-04-26T22:03:34.990272+0000","last_clean":"2024-04-26T22:03:34.990272+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T22:03:34.990272+0000","last_undegraded":"2024-04-26T22:03:34.990272+0000","last_fullsized":"2024-04-26T22:03:34.990272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'495","reported_seq":530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049581+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T22:03:43.049581+0000","last_peered":"2024-04-26T22:03:43.049581+0000","last_clean":"2024-04-26T22:03:43.049581+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T22:03:43.049581+0000","last_undegraded":"2024-04-26T22:03:43.049581+0000","last_fullsized":"2024-04-26T22:03:43.049581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'1459","reported_seq":1496,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:00:39.735974+0000","last_change":"2024-04-26T21:37:16.418849+0000","last_active":"2024-04-26T22:00:39.735974+0000","last_peered":"2024-04-26T22:00:39.735974+0000","last_clean":"2024-04-26T22:00:39.735974+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T22:00:39.735974+0000","last_undegraded":"2024-04-26T22:00:39.735974+0000","last_fullsized":"2024-04-26T22:00:39.735974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1459,"log_dups_size":0,"ondisk_log_size":1459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1458,"num_write_kb":12981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'2194","reported_seq":2224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194184+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T22:03:35.194184+0000","last_peered":"2024-04-26T22:03:35.194184+0000","last_clean":"2024-04-26T22:03:35.194184+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T22:03:35.194184+0000","last_undegraded":"2024-04-26T22:03:35.194184+0000","last_fullsized":"2024-04-26T22:03:35.194184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":50061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'500","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044208+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T22:03:43.044208+0000","last_peered":"2024-04-26T22:03:43.044208+0000","last_clean":"2024-04-26T22:03:43.044208+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T22:03:43.044208+0000","last_undegraded":"2024-04-26T22:03:43.044208+0000","last_fullsized":"2024-04-26T22:03:43.044208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1056","reported_seq":1093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744374+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T22:03:37.744374+0000","last_peered":"2024-04-26T22:03:37.744374+0000","last_clean":"2024-04-26T22:03:37.744374+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T22:03:37.744374+0000","last_undegraded":"2024-04-26T22:03:37.744374+0000","last_fullsized":"2024-04-26T22:03:37.744374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1056,"log_dups_size":0,"ondisk_log_size":1056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":8718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2324","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.179489+0000","last_change":"2024-04-26T21:37:58.755793+0000","last_active":"2024-04-26T22:03:35.179489+0000","last_peered":"2024-04-26T22:03:35.179489+0000","last_clean":"2024-04-26T22:03:35.179489+0000","last_became_active":"2024-04-26T21:37:58.754532+0000","last_became_peered":"2024-04-26T21:37:58.754532+0000","last_unstale":"2024-04-26T22:03:35.179489+0000","last_undegraded":"2024-04-26T22:03:35.179489+0000","last_fullsized":"2024-04-26T22:03:35.179489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:33.156609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":34587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'539","reported_seq":574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043597+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T22:03:43.043597+0000","last_peered":"2024-04-26T22:03:43.043597+0000","last_clean":"2024-04-26T22:03:43.043597+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T22:03:43.043597+0000","last_undegraded":"2024-04-26T22:03:43.043597+0000","last_fullsized":"2024-04-26T22:03:43.043597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'941","reported_seq":978,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.735703+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T22:03:36.735703+0000","last_peered":"2024-04-26T22:03:36.735703+0000","last_clean":"2024-04-26T22:03:36.735703+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T22:03:36.735703+0000","last_undegraded":"2024-04-26T22:03:36.735703+0000","last_fullsized":"2024-04-26T22:03:36.735703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":8676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'1956","reported_seq":1984,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.235647+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T22:03:35.235647+0000","last_peered":"2024-04-26T22:03:35.235647+0000","last_clean":"2024-04-26T22:03:35.235647+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T22:03:35.235647+0000","last_undegraded":"2024-04-26T22:03:35.235647+0000","last_fullsized":"2024-04-26T22:03:35.235647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1956,"log_dups_size":0,"ondisk_log_size":1956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1477,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'502","reported_seq":537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031635+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T22:03:43.031635+0000","last_peered":"2024-04-26T22:03:43.031635+0000","last_clean":"2024-04-26T22:03:43.031635+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T22:03:43.031635+0000","last_undegraded":"2024-04-26T22:03:43.031635+0000","last_fullsized":"2024-04-26T22:03:43.031635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'16","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748578+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T22:03:36.748578+0000","last_peered":"2024-04-26T22:03:36.748578+0000","last_clean":"2024-04-26T22:03:36.748578+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T22:03:36.748578+0000","last_undegraded":"2024-04-26T22:03:36.748578+0000","last_fullsized":"2024-04-26T22:03:36.748578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2142","reported_seq":2170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227910+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T22:03:35.227910+0000","last_peered":"2024-04-26T22:03:35.227910+0000","last_clean":"2024-04-26T22:03:35.227910+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T22:03:35.227910+0000","last_undegraded":"2024-04-26T22:03:35.227910+0000","last_fullsized":"2024-04-26T22:03:35.227910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1648,"num_write_kb":35594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'514","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046487+0000","last_change":"2024-04-26T21:37:58.752144+0000","last_active":"2024-04-26T22:03:43.046487+0000","last_peered":"2024-04-26T22:03:43.046487+0000","last_clean":"2024-04-26T22:03:43.046487+0000","last_became_active":"2024-04-26T21:37:58.751458+0000","last_became_peered":"2024-04-26T21:37:58.751458+0000","last_unstale":"2024-04-26T22:03:43.046487+0000","last_undegraded":"2024-04-26T22:03:43.046487+0000","last_fullsized":"2024-04-26T22:03:43.046487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744268+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T22:03:37.744268+0000","last_peered":"2024-04-26T22:03:37.744268+0000","last_clean":"2024-04-26T22:03:37.744268+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T22:03:37.744268+0000","last_undegraded":"2024-04-26T22:03:37.744268+0000","last_fullsized":"2024-04-26T22:03:37.744268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'2060","reported_seq":2089,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.191326+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T22:03:35.191326+0000","last_peered":"2024-04-26T22:03:35.191326+0000","last_clean":"2024-04-26T22:03:35.191326+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T22:03:35.191326+0000","last_undegraded":"2024-04-26T22:03:35.191326+0000","last_fullsized":"2024-04-26T22:03:35.191326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1564,"num_write_kb":74671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'496","reported_seq":531,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047065+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T22:03:43.047065+0000","last_peered":"2024-04-26T22:03:43.047065+0000","last_clean":"2024-04-26T22:03:43.047065+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T22:03:43.047065+0000","last_undegraded":"2024-04-26T22:03:43.047065+0000","last_fullsized":"2024-04-26T22:03:43.047065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'1736","reported_seq":1773,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:00.173209+0000","last_change":"2024-04-26T21:37:16.434513+0000","last_active":"2024-04-26T22:03:00.173209+0000","last_peered":"2024-04-26T22:03:00.173209+0000","last_clean":"2024-04-26T22:03:00.173209+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T22:03:00.173209+0000","last_undegraded":"2024-04-26T22:03:00.173209+0000","last_fullsized":"2024-04-26T22:03:00.173209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1736,"log_dups_size":0,"ondisk_log_size":1736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1738,"num_write_kb":13055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'1982","reported_seq":2010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.219591+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T22:03:35.219591+0000","last_peered":"2024-04-26T22:03:35.219591+0000","last_clean":"2024-04-26T22:03:35.219591+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T22:03:35.219591+0000","last_undegraded":"2024-04-26T22:03:35.219591+0000","last_fullsized":"2024-04-26T22:03:35.219591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1494,"num_write_kb":56826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'493","reported_seq":527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050223+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T22:03:43.050223+0000","last_peered":"2024-04-26T22:03:43.050223+0000","last_clean":"2024-04-26T22:03:43.050223+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T22:03:43.050223+0000","last_undegraded":"2024-04-26T22:03:43.050223+0000","last_fullsized":"2024-04-26T22:03:43.050223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'2892","reported_seq":2929,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:14.273307+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T22:03:14.273307+0000","last_peered":"2024-04-26T22:03:14.273307+0000","last_clean":"2024-04-26T22:03:14.273307+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T22:03:14.273307+0000","last_undegraded":"2024-04-26T22:03:14.273307+0000","last_fullsized":"2024-04-26T22:03:14.273307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2888,"num_write_kb":21928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'2295","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.243563+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T22:03:35.243563+0000","last_peered":"2024-04-26T22:03:35.243563+0000","last_clean":"2024-04-26T22:03:35.243563+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T22:03:35.243563+0000","last_undegraded":"2024-04-26T22:03:35.243563+0000","last_fullsized":"2024-04-26T22:03:35.243563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":114189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'491","reported_seq":526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047946+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T22:03:43.047946+0000","last_peered":"2024-04-26T22:03:43.047946+0000","last_clean":"2024-04-26T22:03:43.047946+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T22:03:43.047946+0000","last_undegraded":"2024-04-26T22:03:43.047946+0000","last_fullsized":"2024-04-26T22:03:43.047946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3654","reported_seq":3690,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:39.737799+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T22:03:39.737799+0000","last_peered":"2024-04-26T22:03:39.737799+0000","last_clean":"2024-04-26T22:03:39.737799+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T22:03:39.737799+0000","last_undegraded":"2024-04-26T22:03:39.737799+0000","last_fullsized":"2024-04-26T22:03:39.737799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3659,"num_write_kb":22929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'2192","reported_seq":2221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186824+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T22:03:35.186824+0000","last_peered":"2024-04-26T22:03:35.186824+0000","last_clean":"2024-04-26T22:03:35.186824+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T22:03:35.186824+0000","last_undegraded":"2024-04-26T22:03:35.186824+0000","last_fullsized":"2024-04-26T22:03:35.186824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2192,"log_dups_size":0,"ondisk_log_size":2192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":143042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'491","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.017358+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T22:03:43.017358+0000","last_peered":"2024-04-26T22:03:43.017358+0000","last_clean":"2024-04-26T22:03:43.017358+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T22:03:43.017358+0000","last_undegraded":"2024-04-26T22:03:43.017358+0000","last_fullsized":"2024-04-26T22:03:43.017358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2006","reported_seq":2042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.737621+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T22:03:35.737621+0000","last_peered":"2024-04-26T22:03:35.737621+0000","last_clean":"2024-04-26T22:03:35.737621+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T22:03:35.737621+0000","last_undegraded":"2024-04-26T22:03:35.737621+0000","last_fullsized":"2024-04-26T22:03:35.737621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":21501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'2154","reported_seq":2183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.152690+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T22:03:35.152690+0000","last_peered":"2024-04-26T22:03:35.152690+0000","last_clean":"2024-04-26T22:03:35.152690+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T22:03:35.152690+0000","last_undegraded":"2024-04-26T22:03:35.152690+0000","last_fullsized":"2024-04-26T22:03:35.152690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1666,"num_write_kb":39964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'495","reported_seq":515,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046220+0000","last_change":"2024-04-26T21:37:58.753596+0000","last_active":"2024-04-26T22:03:43.046220+0000","last_peered":"2024-04-26T22:03:43.046220+0000","last_clean":"2024-04-26T22:03:43.046220+0000","last_became_active":"2024-04-26T21:37:58.752756+0000","last_became_peered":"2024-04-26T21:37:58.752756+0000","last_unstale":"2024-04-26T22:03:43.046220+0000","last_undegraded":"2024-04-26T22:03:43.046220+0000","last_fullsized":"2024-04-26T22:03:43.046220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'566","reported_seq":602,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.749120+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T22:03:36.749120+0000","last_peered":"2024-04-26T22:03:36.749120+0000","last_clean":"2024-04-26T22:03:36.749120+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T22:03:36.749120+0000","last_undegraded":"2024-04-26T22:03:36.749120+0000","last_fullsized":"2024-04-26T22:03:36.749120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'2246","reported_seq":2275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.171910+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T22:03:35.171910+0000","last_peered":"2024-04-26T22:03:35.171910+0000","last_clean":"2024-04-26T22:03:35.171910+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T22:03:35.171910+0000","last_undegraded":"2024-04-26T22:03:35.171910+0000","last_fullsized":"2024-04-26T22:03:35.171910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1740,"num_write_kb":51745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'2287","reported_seq":2318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.733263+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T22:03:35.733263+0000","last_peered":"2024-04-26T22:03:35.733263+0000","last_clean":"2024-04-26T22:03:35.733263+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T22:03:35.733263+0000","last_undegraded":"2024-04-26T22:03:35.733263+0000","last_fullsized":"2024-04-26T22:03:35.733263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1846,"num_write_kb":61262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'494","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.028441+0000","last_change":"2024-04-26T21:37:17.435754+0000","last_active":"2024-04-26T22:03:43.028441+0000","last_peered":"2024-04-26T22:03:43.028441+0000","last_clean":"2024-04-26T22:03:43.028441+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T22:03:43.028441+0000","last_undegraded":"2024-04-26T22:03:43.028441+0000","last_fullsized":"2024-04-26T22:03:43.028441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2601","reported_seq":2637,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.751315+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T22:03:36.751315+0000","last_peered":"2024-04-26T22:03:36.751315+0000","last_clean":"2024-04-26T22:03:36.751315+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T22:03:36.751315+0000","last_undegraded":"2024-04-26T22:03:36.751315+0000","last_fullsized":"2024-04-26T22:03:36.751315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2601,"num_write_kb":21771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'2012","reported_seq":2042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.213549+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T22:03:35.213549+0000","last_peered":"2024-04-26T22:03:35.213549+0000","last_clean":"2024-04-26T22:03:35.213549+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T22:03:35.213549+0000","last_undegraded":"2024-04-26T22:03:35.213549+0000","last_fullsized":"2024-04-26T22:03:35.213549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1553,"num_write_kb":109022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'573","reported_seq":607,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036233+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T22:03:43.036233+0000","last_peered":"2024-04-26T22:03:43.036233+0000","last_clean":"2024-04-26T22:03:43.036233+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T22:03:43.036233+0000","last_undegraded":"2024-04-26T22:03:43.036233+0000","last_fullsized":"2024-04-26T22:03:43.036233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'453","reported_seq":489,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.747058+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T22:03:37.747058+0000","last_peered":"2024-04-26T22:03:37.747058+0000","last_clean":"2024-04-26T22:03:37.747058+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T22:03:37.747058+0000","last_undegraded":"2024-04-26T22:03:37.747058+0000","last_fullsized":"2024-04-26T22:03:37.747058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3504","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750936+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T22:03:37.750936+0000","last_peered":"2024-04-26T22:03:37.750936+0000","last_clean":"2024-04-26T22:03:37.750936+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T22:03:37.750936+0000","last_undegraded":"2024-04-26T22:03:37.750936+0000","last_fullsized":"2024-04-26T22:03:37.750936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3514,"num_write_kb":30405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'488","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047178+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T22:03:43.047178+0000","last_peered":"2024-04-26T22:03:43.047178+0000","last_clean":"2024-04-26T22:03:43.047178+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T22:03:43.047178+0000","last_undegraded":"2024-04-26T22:03:43.047178+0000","last_fullsized":"2024-04-26T22:03:43.047178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'2142","reported_seq":2177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.121545+0000","last_change":"2024-04-26T21:37:59.072851+0000","last_active":"2024-04-26T22:03:35.121545+0000","last_peered":"2024-04-26T22:03:35.121545+0000","last_clean":"2024-04-26T22:03:35.121545+0000","last_became_active":"2024-04-26T21:37:59.071221+0000","last_became_peered":"2024-04-26T21:37:59.071221+0000","last_unstale":"2024-04-26T22:03:35.121545+0000","last_undegraded":"2024-04-26T22:03:35.121545+0000","last_fullsized":"2024-04-26T22:03:35.121545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1199","reported_seq":1235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.748058+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T22:03:37.748058+0000","last_peered":"2024-04-26T22:03:37.748058+0000","last_clean":"2024-04-26T22:03:37.748058+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T22:03:37.748058+0000","last_undegraded":"2024-04-26T22:03:37.748058+0000","last_fullsized":"2024-04-26T22:03:37.748058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'501","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038699+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T22:03:43.038699+0000","last_peered":"2024-04-26T22:03:43.038699+0000","last_clean":"2024-04-26T22:03:43.038699+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T22:03:43.038699+0000","last_undegraded":"2024-04-26T22:03:43.038699+0000","last_fullsized":"2024-04-26T22:03:43.038699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'1931","reported_seq":1959,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.228754+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T22:03:35.228754+0000","last_peered":"2024-04-26T22:03:35.228754+0000","last_clean":"2024-04-26T22:03:35.228754+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T22:03:35.228754+0000","last_undegraded":"2024-04-26T22:03:35.228754+0000","last_fullsized":"2024-04-26T22:03:35.228754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1423,"num_write_kb":55204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'524","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.042836+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T22:03:43.042836+0000","last_peered":"2024-04-26T22:03:43.042836+0000","last_clean":"2024-04-26T22:03:43.042836+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T22:03:43.042836+0000","last_undegraded":"2024-04-26T22:03:43.042836+0000","last_fullsized":"2024-04-26T22:03:43.042836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'551","reported_seq":587,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.023075+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T22:03:43.023075+0000","last_peered":"2024-04-26T22:03:43.023075+0000","last_clean":"2024-04-26T22:03:43.023075+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T22:03:43.023075+0000","last_undegraded":"2024-04-26T22:03:43.023075+0000","last_fullsized":"2024-04-26T22:03:43.023075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:06.431151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'499","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029683+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T22:03:43.029683+0000","last_peered":"2024-04-26T22:03:43.029683+0000","last_clean":"2024-04-26T22:03:43.029683+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T22:03:43.029683+0000","last_undegraded":"2024-04-26T22:03:43.029683+0000","last_fullsized":"2024-04-26T22:03:43.029683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'508","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029954+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T22:03:43.029954+0000","last_peered":"2024-04-26T22:03:43.029954+0000","last_clean":"2024-04-26T22:03:43.029954+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T22:03:43.029954+0000","last_undegraded":"2024-04-26T22:03:43.029954+0000","last_fullsized":"2024-04-26T22:03:43.029954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'476","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045803+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T22:03:43.045803+0000","last_peered":"2024-04-26T22:03:43.045803+0000","last_clean":"2024-04-26T22:03:43.045803+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T22:03:43.045803+0000","last_undegraded":"2024-04-26T22:03:43.045803+0000","last_fullsized":"2024-04-26T22:03:43.045803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'489","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026150+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T22:03:43.026150+0000","last_peered":"2024-04-26T22:03:43.026150+0000","last_clean":"2024-04-26T22:03:43.026150+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T22:03:43.026150+0000","last_undegraded":"2024-04-26T22:03:43.026150+0000","last_fullsized":"2024-04-26T22:03:43.026150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'522","reported_seq":558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050293+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T22:03:43.050293+0000","last_peered":"2024-04-26T22:03:43.050293+0000","last_clean":"2024-04-26T22:03:43.050293+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T22:03:43.050293+0000","last_undegraded":"2024-04-26T22:03:43.050293+0000","last_fullsized":"2024-04-26T22:03:43.050293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'475","reported_seq":511,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047218+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T22:03:43.047218+0000","last_peered":"2024-04-26T22:03:43.047218+0000","last_clean":"2024-04-26T22:03:43.047218+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T22:03:43.047218+0000","last_undegraded":"2024-04-26T22:03:43.047218+0000","last_fullsized":"2024-04-26T22:03:43.047218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'513","reported_seq":534,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031332+0000","last_change":"2024-04-26T21:37:58.751645+0000","last_active":"2024-04-26T22:03:43.031332+0000","last_peered":"2024-04-26T22:03:43.031332+0000","last_clean":"2024-04-26T22:03:43.031332+0000","last_became_active":"2024-04-26T21:37:58.749833+0000","last_became_peered":"2024-04-26T21:37:58.749833+0000","last_unstale":"2024-04-26T22:03:43.031332+0000","last_undegraded":"2024-04-26T22:03:43.031332+0000","last_fullsized":"2024-04-26T22:03:43.031332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:15.821911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"26'482","reported_seq":517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045694+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T22:03:43.045694+0000","last_peered":"2024-04-26T22:03:43.045694+0000","last_clean":"2024-04-26T22:03:43.045694+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T22:03:43.045694+0000","last_undegraded":"2024-04-26T22:03:43.045694+0000","last_fullsized":"2024-04-26T22:03:43.045694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'530","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047951+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T22:03:43.047951+0000","last_peered":"2024-04-26T22:03:43.047951+0000","last_clean":"2024-04-26T22:03:43.047951+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T22:03:43.047951+0000","last_undegraded":"2024-04-26T22:03:43.047951+0000","last_fullsized":"2024-04-26T22:03:43.047951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'488","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047329+0000","last_change":"2024-04-26T21:37:17.439778+0000","last_active":"2024-04-26T22:03:43.047329+0000","last_peered":"2024-04-26T22:03:43.047329+0000","last_clean":"2024-04-26T22:03:43.047329+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T22:03:43.047329+0000","last_undegraded":"2024-04-26T22:03:43.047329+0000","last_fullsized":"2024-04-26T22:03:43.047329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'512","reported_seq":547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044243+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T22:03:43.044243+0000","last_peered":"2024-04-26T22:03:43.044243+0000","last_clean":"2024-04-26T22:03:43.044243+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T22:03:43.044243+0000","last_undegraded":"2024-04-26T22:03:43.044243+0000","last_fullsized":"2024-04-26T22:03:43.044243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'505","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049561+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T22:03:43.049561+0000","last_peered":"2024-04-26T22:03:43.049561+0000","last_clean":"2024-04-26T22:03:43.049561+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T22:03:43.049561+0000","last_undegraded":"2024-04-26T22:03:43.049561+0000","last_fullsized":"2024-04-26T22:03:43.049561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'459","reported_seq":494,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039316+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T22:03:43.039316+0000","last_peered":"2024-04-26T22:03:43.039316+0000","last_clean":"2024-04-26T22:03:43.039316+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T22:03:43.039316+0000","last_undegraded":"2024-04-26T22:03:43.039316+0000","last_fullsized":"2024-04-26T22:03:43.039316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:34.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'525","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050851+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T22:03:43.050851+0000","last_peered":"2024-04-26T22:03:43.050851+0000","last_clean":"2024-04-26T22:03:43.050851+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T22:03:43.050851+0000","last_undegraded":"2024-04-26T22:03:43.050851+0000","last_fullsized":"2024-04-26T22:03:43.050851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'520","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037528+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T22:03:43.037528+0000","last_peered":"2024-04-26T22:03:43.037528+0000","last_clean":"2024-04-26T22:03:43.037528+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T22:03:43.037528+0000","last_undegraded":"2024-04-26T22:03:43.037528+0000","last_fullsized":"2024-04-26T22:03:43.037528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'505","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.022688+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T22:03:43.022688+0000","last_peered":"2024-04-26T22:03:43.022688+0000","last_clean":"2024-04-26T22:03:43.022688+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T22:03:43.022688+0000","last_undegraded":"2024-04-26T22:03:43.022688+0000","last_fullsized":"2024-04-26T22:03:43.022688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'510","reported_seq":545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035772+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T22:03:43.035772+0000","last_peered":"2024-04-26T22:03:43.035772+0000","last_clean":"2024-04-26T22:03:43.035772+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T22:03:43.035772+0000","last_undegraded":"2024-04-26T22:03:43.035772+0000","last_fullsized":"2024-04-26T22:03:43.035772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:38.335510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'476","reported_seq":510,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035648+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T22:03:43.035648+0000","last_peered":"2024-04-26T22:03:43.035648+0000","last_clean":"2024-04-26T22:03:43.035648+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T22:03:43.035648+0000","last_undegraded":"2024-04-26T22:03:43.035648+0000","last_fullsized":"2024-04-26T22:03:43.035648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'494","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037947+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T22:03:43.037947+0000","last_peered":"2024-04-26T22:03:43.037947+0000","last_clean":"2024-04-26T22:03:43.037947+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T22:03:43.037947+0000","last_undegraded":"2024-04-26T22:03:43.037947+0000","last_fullsized":"2024-04-26T22:03:43.037947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'475","reported_seq":509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032023+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T22:03:43.032023+0000","last_peered":"2024-04-26T22:03:43.032023+0000","last_clean":"2024-04-26T22:03:43.032023+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T22:03:43.032023+0000","last_undegraded":"2024-04-26T22:03:43.032023+0000","last_fullsized":"2024-04-26T22:03:43.032023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049937+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T22:03:43.049937+0000","last_peered":"2024-04-26T22:03:43.049937+0000","last_clean":"2024-04-26T22:03:43.049937+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T22:03:43.049937+0000","last_undegraded":"2024-04-26T22:03:43.049937+0000","last_fullsized":"2024-04-26T22:03:43.049937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'506","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051623+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T22:03:43.051623+0000","last_peered":"2024-04-26T22:03:43.051623+0000","last_clean":"2024-04-26T22:03:43.051623+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T22:03:43.051623+0000","last_undegraded":"2024-04-26T22:03:43.051623+0000","last_fullsized":"2024-04-26T22:03:43.051623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'470","reported_seq":490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.024943+0000","last_change":"2024-04-26T21:37:59.071288+0000","last_active":"2024-04-26T22:03:43.024943+0000","last_peered":"2024-04-26T22:03:43.024943+0000","last_clean":"2024-04-26T22:03:43.024943+0000","last_became_active":"2024-04-26T21:37:59.070372+0000","last_became_peered":"2024-04-26T21:37:59.070372+0000","last_unstale":"2024-04-26T22:03:43.024943+0000","last_undegraded":"2024-04-26T22:03:43.024943+0000","last_fullsized":"2024-04-26T22:03:43.024943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037366+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T22:03:43.037366+0000","last_peered":"2024-04-26T22:03:43.037366+0000","last_clean":"2024-04-26T22:03:43.037366+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T22:03:43.037366+0000","last_undegraded":"2024-04-26T22:03:43.037366+0000","last_fullsized":"2024-04-26T22:03:43.037366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'482","reported_seq":516,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038091+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T22:03:43.038091+0000","last_peered":"2024-04-26T22:03:43.038091+0000","last_clean":"2024-04-26T22:03:43.038091+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T22:03:43.038091+0000","last_undegraded":"2024-04-26T22:03:43.038091+0000","last_fullsized":"2024-04-26T22:03:43.038091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'509","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044575+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T22:03:43.044575+0000","last_peered":"2024-04-26T22:03:43.044575+0000","last_clean":"2024-04-26T22:03:43.044575+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T22:03:43.044575+0000","last_undegraded":"2024-04-26T22:03:43.044575+0000","last_fullsized":"2024-04-26T22:03:43.044575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'509","reported_seq":546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036324+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T22:03:43.036324+0000","last_peered":"2024-04-26T22:03:43.036324+0000","last_clean":"2024-04-26T22:03:43.036324+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T22:03:43.036324+0000","last_undegraded":"2024-04-26T22:03:43.036324+0000","last_fullsized":"2024-04-26T22:03:43.036324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'488","reported_seq":524,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026593+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T22:03:43.026593+0000","last_peered":"2024-04-26T22:03:43.026593+0000","last_clean":"2024-04-26T22:03:43.026593+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T22:03:43.026593+0000","last_undegraded":"2024-04-26T22:03:43.026593+0000","last_fullsized":"2024-04-26T22:03:43.026593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'487","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035868+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T22:03:43.035868+0000","last_peered":"2024-04-26T22:03:43.035868+0000","last_clean":"2024-04-26T22:03:43.035868+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T22:03:43.035868+0000","last_undegraded":"2024-04-26T22:03:43.035868+0000","last_fullsized":"2024-04-26T22:03:43.035868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'477","reported_seq":513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050222+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T22:03:43.050222+0000","last_peered":"2024-04-26T22:03:43.050222+0000","last_clean":"2024-04-26T22:03:43.050222+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T22:03:43.050222+0000","last_undegraded":"2024-04-26T22:03:43.050222+0000","last_fullsized":"2024-04-26T22:03:43.050222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52831,"num_write_kb":2071742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68463,"ondisk_log_size":68463,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31956,"ondisk_log_size":31956,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":240160580,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":58365,"num_write_kb":440912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":480378880,"data_stored":480321160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55415,"ondisk_log_size":55415,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575170,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279712,"kb_used_data":50008,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94092128,"statfs":{"total":96636764160,"available":96350339072,"internally_reserved":0,"allocated":51208192,"data_stored":51036951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575170,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325152,"kb_used_data":63576,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94046688,"statfs":{"total":96636764160,"available":96303808512,"internally_reserved":0,"allocated":65101824,"data_stored":64928594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575171,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":69908,"kb_used_omap":1,"kb_used_meta":233726,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":71585792,"data_stored":71417611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239335877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575171,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309348,"kb_used_data":65820,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94062492,"statfs":{"total":96636764160,"available":96319991808,"internally_reserved":0,"allocated":67399680,"data_stored":67223343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249362886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575170,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397252,"kb_used_data":73212,"kb_used_omap":1,"kb_used_meta":324030,"kb_avail":93974588,"statfs":{"total":96636764160,"available":96229978112,"internally_reserved":0,"allocated":74969088,"data_stored":74797270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":331807175},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211836,"kb_used_data":36340,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94160004,"statfs":{"total":96636764160,"available":96419844096,"internally_reserved":0,"allocated":37212160,"data_stored":37047862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575172,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":427680,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93944160,"statfs":{"total":96636764160,"available":96198819840,"internally_reserved":0,"allocated":77684736,"data_stored":77510994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257640,"kb_used_data":37728,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94114200,"statfs":{"total":96636764160,"available":96372940800,"internally_reserved":0,"allocated":38633472,"data_stored":38454095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225180102},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77406208,"data_stored":77396641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36933632,"data_stored":36933509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74690560,"data_stored":74682917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":67121152,"data_stored":67108990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64823296,"data_stored":64814241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:03:49.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:03:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.155+0000 7f744dc00640 1 Processor -- start 2024-04-26T22:03:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.155+0000 7f744dc00640 1 -- start start 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f744dc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f7448142270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f744dc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74481427b0 0x7f7448152f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f744dc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74480b5390 con 0x7f74480baf30 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f744dc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f74480b5b50 con 0x7f74481427b0 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f744dc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f74480bb310 con 0x7f74480b6640 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f7447400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74481427b0 0x7f7448152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f7447400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74481427b0 0x7f7448152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34174/0 (socket says 172.21.15.5:34174) 2024-04-26T22:03:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.156+0000 7f7447400640 1 -- 172.21.15.5:0/2137264948 learned_addr learned my addr 172.21.15.5:0/2137264948 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.157+0000 7f7446000640 1 --2- 172.21.15.5:0/2137264948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f7448142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.157+0000 7f7447400640 1 -- 172.21.15.5:0/2137264948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 msgr2=0x7f7448142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.157+0000 7f7447400640 1 --2- 172.21.15.5:0/2137264948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f7448142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.157+0000 7f7447400640 1 -- 172.21.15.5:0/2137264948 >> v1:172.21.15.112:6789/0 conn(0x7f74480baf30 legacy=0x7f744814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.157+0000 7f7447400640 1 -- 172.21.15.5:0/2137264948 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74480b7a90 con 0x7f74481427b0 2024-04-26T22:03:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.158+0000 7f7447400640 1 --2- 172.21.15.5:0/2137264948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74481427b0 0x7f7448152f10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7440009e50 tx=0x7f744002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dea26a637772270 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.158+0000 7f7445600640 1 -- 172.21.15.5:0/2137264948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440036070 con 0x7f74481427b0 2024-04-26T22:03:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.158+0000 7f7445600640 1 -- 172.21.15.5:0/2137264948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7440031600 con 0x7f74481427b0 2024-04-26T22:03:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.158+0000 7f7445600640 1 -- 172.21.15.5:0/2137264948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74400319d0 con 0x7f74481427b0 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 -- 172.21.15.5:0/2137264948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74481427b0 msgr2=0x7f7448152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 --2- 172.21.15.5:0/2137264948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74481427b0 0x7f7448152f10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7440009e50 tx=0x7f744002a630 comp rx=0 tx=0).stop 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 -- 172.21.15.5:0/2137264948 shutdown_connections 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 --2- 172.21.15.5:0/2137264948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74481427b0 0x7f7448152f10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 --2- 172.21.15.5:0/2137264948 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f7448142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 -- 172.21.15.5:0/2137264948 >> 172.21.15.5:0/2137264948 conn(0x7f7448068270 msgr2=0x7f7448068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 -- 172.21.15.5:0/2137264948 shutdown_connections 2024-04-26T22:03:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.159+0000 7f744dc00640 1 -- 172.21.15.5:0/2137264948 wait complete. 2024-04-26T22:03:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.161+0000 7f744dc00640 1 Processor -- start 2024-04-26T22:03:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.161+0000 7f744dc00640 1 -- start start 2024-04-26T22:03:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f744dc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f74480bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f744dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480baf30 0x7f74481e1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f744dc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74481427b0 0x7f74481e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f744dc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74480b76f0 con 0x7f74480baf30 2024-04-26T22:03:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f744dc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74480b7d70 con 0x7f74481427b0 2024-04-26T22:03:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f744dc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f74480b7870 con 0x7f74480b6640 2024-04-26T22:03:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480baf30 0x7f74481e1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480baf30 0x7f74481e1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34178/0 (socket says 172.21.15.5:34178) 2024-04-26T22:03:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 -- 172.21.15.5:0/2873402687 learned_addr learned my addr 172.21.15.5:0/2873402687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446a00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f74480bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7447400640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74481427b0 0x7f74481e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 -- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 msgr2=0x7f74480bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f74480bdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 -- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74481427b0 msgr2=0x7f74481e1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74481427b0 0x7f74481e1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446000640 1 -- 172.21.15.5:0/2873402687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744813b540 con 0x7f74480baf30 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.162+0000 7f7446a00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f74480bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.163+0000 7f7446000640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480baf30 0x7f74481e1a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f743400d620 tx=0x7f743400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.163+0000 7f743ea00640 1 -- 172.21.15.5:0/2873402687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743400b620 con 0x7f74480baf30 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.163+0000 7f743ea00640 1 -- 172.21.15.5:0/2873402687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7434019070 con 0x7f74480baf30 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.163+0000 7f743ea00640 1 -- 172.21.15.5:0/2873402687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743400ba00 con 0x7f74480baf30 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.163+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7448143d60 con 0x7f74480baf30 2024-04-26T22:03:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.163+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744813b7b0 con 0x7f74480baf30 2024-04-26T22:03:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.164+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7448075db0 con 0x7f74480baf30 2024-04-26T22:03:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.165+0000 7f743ea00640 1 -- 172.21.15.5:0/2873402687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f743400bba0 con 0x7f74480baf30 2024-04-26T22:03:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.166+0000 7f743ea00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f742806c920 0x7f742806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.166+0000 7f743ea00640 1 -- 172.21.15.5:0/2873402687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f743408c300 con 0x7f74480baf30 2024-04-26T22:03:50.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.167+0000 7f7446a00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f742806c920 0x7f742806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.168+0000 7f7446a00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f742806c920 0x7f742806ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7438003eb0 tx=0x7f7438009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:50.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.171+0000 7f743ea00640 1 -- 172.21.15.5:0/2873402687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f743405a320 con 0x7f74480baf30 2024-04-26T22:03:50.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.374+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74480b6070 con 0x7f742806c920 2024-04-26T22:03:50.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.398+0000 7f743ea00640 1 -- 172.21.15.5:0/2873402687 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334697 (secure 0 0 0) 0x7f7438069b80 con 0x7f742806c920 2024-04-26T22:03:50.402 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:03:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T22:03:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f742806c920 msgr2=0x7f742806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f742806c920 0x7f742806ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7438003eb0 tx=0x7f7438009040 comp rx=0 tx=0).stop 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480baf30 msgr2=0x7f74481e1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480baf30 0x7f74481e1a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f743400d620 tx=0x7f743400dae0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 shutdown_connections 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74481427b0 0x7f74481e1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f742806c920 0x7f742806ede0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480baf30 0x7f74481e1a80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 --2- 172.21.15.5:0/2873402687 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74480b6640 0x7f74480bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 >> 172.21.15.5:0/2873402687 conn(0x7f7448068270 msgr2=0x7f7448148600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 shutdown_connections 2024-04-26T22:03:50.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.404+0000 7f744dc00640 1 -- 172.21.15.5:0/2873402687 wait complete. 2024-04-26T22:03:50.424 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":822,"stamp":"2024-04-26T22:03:50.097800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240755740,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2795,"num_read_kb":5345,"num_write":112477,"num_write_kb":2515076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155953,"ondisk_log_size":155953,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2512272,"kb_used_data":472464,"kb_used_omap":12,"kb_used_meta":2039731,"kb_avail":752462448,"statfs":{"total":773094113280,"available":770521546752,"internally_reserved":0,"allocated":483803136,"data_stored":482426304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2088685108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-93602810,"num_objects":-644,"num_object_clones":0,"num_object_copies":-1874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-644,"num_whiteouts":0,"num_read":12,"num_read_kb":43,"num_write":694,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005147"},"pg_stats":[{"pgid":"2.1f","version":"26'1240","reported_seq":1278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.748279+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T22:03:37.748279+0000","last_peered":"2024-04-26T22:03:37.748279+0000","last_clean":"2024-04-26T22:03:37.748279+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T22:03:37.748279+0000","last_undegraded":"2024-04-26T22:03:37.748279+0000","last_fullsized":"2024-04-26T22:03:37.748279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:32.834699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'475","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032915+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T22:03:43.032915+0000","last_peered":"2024-04-26T22:03:43.032915+0000","last_clean":"2024-04-26T22:03:43.032915+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T22:03:43.032915+0000","last_undegraded":"2024-04-26T22:03:43.032915+0000","last_fullsized":"2024-04-26T22:03:43.032915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'1944","reported_seq":1972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.226697+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T22:03:35.226697+0000","last_peered":"2024-04-26T22:03:35.226697+0000","last_clean":"2024-04-26T22:03:35.226697+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T22:03:35.226697+0000","last_undegraded":"2024-04-26T22:03:35.226697+0000","last_fullsized":"2024-04-26T22:03:35.226697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1944,"log_dups_size":0,"ondisk_log_size":1944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":38072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3188","reported_seq":3227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746607+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T22:03:37.746607+0000","last_peered":"2024-04-26T22:03:37.746607+0000","last_clean":"2024-04-26T22:03:37.746607+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T22:03:37.746607+0000","last_undegraded":"2024-04-26T22:03:37.746607+0000","last_fullsized":"2024-04-26T22:03:37.746607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3196,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'472","reported_seq":508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.017603+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T22:03:43.017603+0000","last_peered":"2024-04-26T22:03:43.017603+0000","last_clean":"2024-04-26T22:03:43.017603+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T22:03:43.017603+0000","last_undegraded":"2024-04-26T22:03:43.017603+0000","last_fullsized":"2024-04-26T22:03:43.017603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2092","reported_seq":2120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194904+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T22:03:35.194904+0000","last_peered":"2024-04-26T22:03:35.194904+0000","last_clean":"2024-04-26T22:03:35.194904+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T22:03:35.194904+0000","last_undegraded":"2024-04-26T22:03:35.194904+0000","last_fullsized":"2024-04-26T22:03:35.194904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":42136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3681","reported_seq":3717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.754029+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T22:03:36.754029+0000","last_peered":"2024-04-26T22:03:36.754029+0000","last_clean":"2024-04-26T22:03:36.754029+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T22:03:36.754029+0000","last_undegraded":"2024-04-26T22:03:36.754029+0000","last_fullsized":"2024-04-26T22:03:36.754029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3687,"num_write_kb":30415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'531","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.040634+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T22:03:43.040634+0000","last_peered":"2024-04-26T22:03:43.040634+0000","last_clean":"2024-04-26T22:03:43.040634+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T22:03:43.040634+0000","last_undegraded":"2024-04-26T22:03:43.040634+0000","last_fullsized":"2024-04-26T22:03:43.040634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'2113","reported_seq":2148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.137495+0000","last_change":"2024-04-26T21:37:58.756041+0000","last_active":"2024-04-26T22:03:35.137495+0000","last_peered":"2024-04-26T22:03:35.137495+0000","last_clean":"2024-04-26T22:03:35.137495+0000","last_became_active":"2024-04-26T21:37:58.754696+0000","last_became_peered":"2024-04-26T21:37:58.754696+0000","last_unstale":"2024-04-26T22:03:35.137495+0000","last_undegraded":"2024-04-26T22:03:35.137495+0000","last_fullsized":"2024-04-26T22:03:35.137495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:14.032751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1612,"num_write_kb":85113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'411","reported_seq":447,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746921+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T22:03:36.746921+0000","last_peered":"2024-04-26T22:03:36.746921+0000","last_clean":"2024-04-26T22:03:36.746921+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T22:03:36.746921+0000","last_undegraded":"2024-04-26T22:03:36.746921+0000","last_fullsized":"2024-04-26T22:03:36.746921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039133+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T22:03:43.039133+0000","last_peered":"2024-04-26T22:03:43.039133+0000","last_clean":"2024-04-26T22:03:43.039133+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T22:03:43.039133+0000","last_undegraded":"2024-04-26T22:03:43.039133+0000","last_fullsized":"2024-04-26T22:03:43.039133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'2117","reported_seq":2145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233562+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T22:03:35.233562+0000","last_peered":"2024-04-26T22:03:35.233562+0000","last_clean":"2024-04-26T22:03:35.233562+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T22:03:35.233562+0000","last_undegraded":"2024-04-26T22:03:35.233562+0000","last_fullsized":"2024-04-26T22:03:35.233562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2117,"log_dups_size":0,"ondisk_log_size":2117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1631,"num_write_kb":60261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'502","reported_seq":538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043741+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T22:03:43.043741+0000","last_peered":"2024-04-26T22:03:43.043741+0000","last_clean":"2024-04-26T22:03:43.043741+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T22:03:43.043741+0000","last_undegraded":"2024-04-26T22:03:43.043741+0000","last_fullsized":"2024-04-26T22:03:43.043741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'2421","reported_seq":2458,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750510+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T22:03:37.750510+0000","last_peered":"2024-04-26T22:03:37.750510+0000","last_clean":"2024-04-26T22:03:37.750510+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T22:03:37.750510+0000","last_undegraded":"2024-04-26T22:03:37.750510+0000","last_fullsized":"2024-04-26T22:03:37.750510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2421,"log_dups_size":0,"ondisk_log_size":2421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":21667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'2164","reported_seq":2193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.113767+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T22:03:35.113767+0000","last_peered":"2024-04-26T22:03:35.113767+0000","last_clean":"2024-04-26T22:03:35.113767+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T22:03:35.113767+0000","last_undegraded":"2024-04-26T22:03:35.113767+0000","last_fullsized":"2024-04-26T22:03:35.113767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2164,"log_dups_size":0,"ondisk_log_size":2164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1702,"num_write_kb":82391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'487","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035776+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T22:03:43.035776+0000","last_peered":"2024-04-26T22:03:43.035776+0000","last_clean":"2024-04-26T22:03:43.035776+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T22:03:43.035776+0000","last_undegraded":"2024-04-26T22:03:43.035776+0000","last_fullsized":"2024-04-26T22:03:43.035776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'2546","reported_seq":2584,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744390+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T22:03:37.744390+0000","last_peered":"2024-04-26T22:03:37.744390+0000","last_clean":"2024-04-26T22:03:37.744390+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T22:03:37.744390+0000","last_undegraded":"2024-04-26T22:03:37.744390+0000","last_fullsized":"2024-04-26T22:03:37.744390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2556,"num_write_kb":21644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'2346","reported_seq":2375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.178720+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T22:03:35.178720+0000","last_peered":"2024-04-26T22:03:35.178720+0000","last_clean":"2024-04-26T22:03:35.178720+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T22:03:35.178720+0000","last_undegraded":"2024-04-26T22:03:35.178720+0000","last_fullsized":"2024-04-26T22:03:35.178720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2346,"log_dups_size":0,"ondisk_log_size":2346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1850,"num_write_kb":43022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'518","reported_seq":554,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032499+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T22:03:43.032499+0000","last_peered":"2024-04-26T22:03:43.032499+0000","last_clean":"2024-04-26T22:03:43.032499+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T22:03:43.032499+0000","last_undegraded":"2024-04-26T22:03:43.032499+0000","last_fullsized":"2024-04-26T22:03:43.032499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'925","reported_seq":963,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:19.800121+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T22:03:19.800121+0000","last_peered":"2024-04-26T22:03:19.800121+0000","last_clean":"2024-04-26T22:03:19.800121+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T22:03:19.800121+0000","last_undegraded":"2024-04-26T22:03:19.800121+0000","last_fullsized":"2024-04-26T22:03:19.800121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":8623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'2213","reported_seq":2242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.222029+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T22:03:35.222029+0000","last_peered":"2024-04-26T22:03:35.222029+0000","last_clean":"2024-04-26T22:03:35.222029+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T22:03:35.222029+0000","last_undegraded":"2024-04-26T22:03:35.222029+0000","last_fullsized":"2024-04-26T22:03:35.222029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2213,"log_dups_size":0,"ondisk_log_size":2213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":80555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.201419+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T22:03:35.201419+0000","last_peered":"2024-04-26T22:03:35.201419+0000","last_clean":"2024-04-26T22:03:35.201419+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T22:03:35.201419+0000","last_undegraded":"2024-04-26T22:03:35.201419+0000","last_fullsized":"2024-04-26T22:03:35.201419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'481","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746018+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T22:03:37.746018+0000","last_peered":"2024-04-26T22:03:37.746018+0000","last_clean":"2024-04-26T22:03:37.746018+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T22:03:37.746018+0000","last_undegraded":"2024-04-26T22:03:37.746018+0000","last_fullsized":"2024-04-26T22:03:37.746018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'1921","reported_seq":1950,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233522+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T22:03:35.233522+0000","last_peered":"2024-04-26T22:03:35.233522+0000","last_clean":"2024-04-26T22:03:35.233522+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T22:03:35.233522+0000","last_undegraded":"2024-04-26T22:03:35.233522+0000","last_fullsized":"2024-04-26T22:03:35.233522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'497","reported_seq":533,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031790+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T22:03:43.031790+0000","last_peered":"2024-04-26T22:03:43.031790+0000","last_clean":"2024-04-26T22:03:43.031790+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T22:03:43.031790+0000","last_undegraded":"2024-04-26T22:03:43.031790+0000","last_fullsized":"2024-04-26T22:03:43.031790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'397","reported_seq":435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.753663+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T22:03:37.753663+0000","last_peered":"2024-04-26T22:03:37.753663+0000","last_clean":"2024-04-26T22:03:37.753663+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T22:03:37.753663+0000","last_undegraded":"2024-04-26T22:03:37.753663+0000","last_fullsized":"2024-04-26T22:03:37.753663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'2230","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082241+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T22:03:35.082241+0000","last_peered":"2024-04-26T22:03:35.082241+0000","last_clean":"2024-04-26T22:03:35.082241+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T22:03:35.082241+0000","last_undegraded":"2024-04-26T22:03:35.082241+0000","last_fullsized":"2024-04-26T22:03:35.082241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2230,"log_dups_size":0,"ondisk_log_size":2230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":137897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'453","reported_seq":489,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049286+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T22:03:43.049286+0000","last_peered":"2024-04-26T22:03:43.049286+0000","last_clean":"2024-04-26T22:03:43.049286+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T22:03:43.049286+0000","last_undegraded":"2024-04-26T22:03:43.049286+0000","last_fullsized":"2024-04-26T22:03:43.049286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1575","reported_seq":1613,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.395295+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T22:03:43.395295+0000","last_peered":"2024-04-26T22:03:43.395295+0000","last_clean":"2024-04-26T22:03:43.395295+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T22:03:43.395295+0000","last_undegraded":"2024-04-26T22:03:43.395295+0000","last_fullsized":"2024-04-26T22:03:43.395295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903801,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4315,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'1970","reported_seq":2001,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227988+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T22:03:35.227988+0000","last_peered":"2024-04-26T22:03:35.227988+0000","last_clean":"2024-04-26T22:03:35.227988+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T22:03:35.227988+0000","last_undegraded":"2024-04-26T22:03:35.227988+0000","last_fullsized":"2024-04-26T22:03:35.227988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1970,"log_dups_size":0,"ondisk_log_size":1970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":39987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'506","reported_seq":542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.019974+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T22:03:43.019974+0000","last_peered":"2024-04-26T22:03:43.019974+0000","last_clean":"2024-04-26T22:03:43.019974+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T22:03:43.019974+0000","last_undegraded":"2024-04-26T22:03:43.019974+0000","last_fullsized":"2024-04-26T22:03:43.019974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2119","reported_seq":2157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748733+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T22:03:36.748733+0000","last_peered":"2024-04-26T22:03:36.748733+0000","last_clean":"2024-04-26T22:03:36.748733+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T22:03:36.748733+0000","last_undegraded":"2024-04-26T22:03:36.748733+0000","last_fullsized":"2024-04-26T22:03:36.748733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2119,"log_dups_size":0,"ondisk_log_size":2119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2125,"num_write_kb":17294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2154","reported_seq":2184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.006513+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T22:03:35.006513+0000","last_peered":"2024-04-26T22:03:35.006513+0000","last_clean":"2024-04-26T22:03:35.006513+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T22:03:35.006513+0000","last_undegraded":"2024-04-26T22:03:35.006513+0000","last_fullsized":"2024-04-26T22:03:35.006513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1661,"num_write_kb":51179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'504","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029821+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T22:03:43.029821+0000","last_peered":"2024-04-26T22:03:43.029821+0000","last_clean":"2024-04-26T22:03:43.029821+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T22:03:43.029821+0000","last_undegraded":"2024-04-26T22:03:43.029821+0000","last_fullsized":"2024-04-26T22:03:43.029821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'363","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.742937+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T22:03:37.742937+0000","last_peered":"2024-04-26T22:03:37.742937+0000","last_clean":"2024-04-26T22:03:37.742937+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T22:03:37.742937+0000","last_undegraded":"2024-04-26T22:03:37.742937+0000","last_fullsized":"2024-04-26T22:03:37.742937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'2388","reported_seq":2418,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.178286+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T22:03:35.178286+0000","last_peered":"2024-04-26T22:03:35.178286+0000","last_clean":"2024-04-26T22:03:35.178286+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T22:03:35.178286+0000","last_undegraded":"2024-04-26T22:03:35.178286+0000","last_fullsized":"2024-04-26T22:03:35.178286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2388,"log_dups_size":0,"ondisk_log_size":2388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":100197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035449+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T22:03:43.035449+0000","last_peered":"2024-04-26T22:03:43.035449+0000","last_clean":"2024-04-26T22:03:43.035449+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T22:03:43.035449+0000","last_undegraded":"2024-04-26T22:03:43.035449+0000","last_fullsized":"2024-04-26T22:03:43.035449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'2499","reported_seq":2537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746933+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T22:03:36.746933+0000","last_peered":"2024-04-26T22:03:36.746933+0000","last_clean":"2024-04-26T22:03:36.746933+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T22:03:36.746933+0000","last_undegraded":"2024-04-26T22:03:36.746933+0000","last_fullsized":"2024-04-26T22:03:36.746933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2499,"log_dups_size":0,"ondisk_log_size":2499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2501,"num_write_kb":21681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2296","reported_seq":2326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.238210+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T22:03:35.238210+0000","last_peered":"2024-04-26T22:03:35.238210+0000","last_clean":"2024-04-26T22:03:35.238210+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T22:03:35.238210+0000","last_undegraded":"2024-04-26T22:03:35.238210+0000","last_fullsized":"2024-04-26T22:03:35.238210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1815,"num_write_kb":51574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'506","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.021708+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T22:03:43.021708+0000","last_peered":"2024-04-26T22:03:43.021708+0000","last_clean":"2024-04-26T22:03:43.021708+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T22:03:43.021708+0000","last_undegraded":"2024-04-26T22:03:43.021708+0000","last_fullsized":"2024-04-26T22:03:43.021708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4043","reported_seq":6760,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.743148+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T22:03:43.743148+0000","last_peered":"2024-04-26T22:03:43.743148+0000","last_clean":"2024-04-26T22:03:43.743148+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T22:03:43.743148+0000","last_undegraded":"2024-04-26T22:03:43.743148+0000","last_fullsized":"2024-04-26T22:03:43.743148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15961989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":4049,"num_write_kb":18210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'1988","reported_seq":2018,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.245965+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T22:03:35.245965+0000","last_peered":"2024-04-26T22:03:35.245965+0000","last_clean":"2024-04-26T22:03:35.245965+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T22:03:35.245965+0000","last_undegraded":"2024-04-26T22:03:35.245965+0000","last_fullsized":"2024-04-26T22:03:35.245965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":88301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'487","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.040601+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T22:03:43.040601+0000","last_peered":"2024-04-26T22:03:43.040601+0000","last_clean":"2024-04-26T22:03:43.040601+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T22:03:43.040601+0000","last_undegraded":"2024-04-26T22:03:43.040601+0000","last_fullsized":"2024-04-26T22:03:43.040601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:03.104148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'2390","reported_seq":2429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746379+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T22:03:36.746379+0000","last_peered":"2024-04-26T22:03:36.746379+0000","last_clean":"2024-04-26T22:03:36.746379+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T22:03:36.746379+0000","last_undegraded":"2024-04-26T22:03:36.746379+0000","last_fullsized":"2024-04-26T22:03:36.746379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2392,"num_write_kb":17555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'2202","reported_seq":2232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.733322+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T22:03:35.733322+0000","last_peered":"2024-04-26T22:03:35.733322+0000","last_clean":"2024-04-26T22:03:35.733322+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T22:03:35.733322+0000","last_undegraded":"2024-04-26T22:03:35.733322+0000","last_fullsized":"2024-04-26T22:03:35.733322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":59602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'492","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031237+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T22:03:43.031237+0000","last_peered":"2024-04-26T22:03:43.031237+0000","last_clean":"2024-04-26T22:03:43.031237+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T22:03:43.031237+0000","last_undegraded":"2024-04-26T22:03:43.031237+0000","last_fullsized":"2024-04-26T22:03:43.031237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'937","reported_seq":975,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748385+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T22:03:36.748385+0000","last_peered":"2024-04-26T22:03:36.748385+0000","last_clean":"2024-04-26T22:03:36.748385+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T22:03:36.748385+0000","last_undegraded":"2024-04-26T22:03:36.748385+0000","last_fullsized":"2024-04-26T22:03:36.748385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:01:09.729938+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T22:01:09.729938+0000","last_peered":"2024-04-26T22:01:09.729938+0000","last_clean":"2024-04-26T22:01:09.729938+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T22:01:09.729938+0000","last_undegraded":"2024-04-26T22:01:09.729938+0000","last_fullsized":"2024-04-26T22:01:09.729938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2218","reported_seq":2248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186238+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T22:03:35.186238+0000","last_peered":"2024-04-26T22:03:35.186238+0000","last_clean":"2024-04-26T22:03:35.186238+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T22:03:35.186238+0000","last_undegraded":"2024-04-26T22:03:35.186238+0000","last_fullsized":"2024-04-26T22:03:35.186238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1718,"num_write_kb":49388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'483","reported_seq":518,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051569+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T22:03:43.051569+0000","last_peered":"2024-04-26T22:03:43.051569+0000","last_clean":"2024-04-26T22:03:43.051569+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T22:03:43.051569+0000","last_undegraded":"2024-04-26T22:03:43.051569+0000","last_fullsized":"2024-04-26T22:03:43.051569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'1337","reported_seq":1374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:14.287687+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T22:03:14.287687+0000","last_peered":"2024-04-26T22:03:14.287687+0000","last_clean":"2024-04-26T22:03:14.287687+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T22:03:14.287687+0000","last_undegraded":"2024-04-26T22:03:14.287687+0000","last_fullsized":"2024-04-26T22:03:14.287687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":12939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'2226","reported_seq":2256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082628+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T22:03:35.082628+0000","last_peered":"2024-04-26T22:03:35.082628+0000","last_clean":"2024-04-26T22:03:35.082628+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T22:03:35.082628+0000","last_undegraded":"2024-04-26T22:03:35.082628+0000","last_fullsized":"2024-04-26T22:03:35.082628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":82996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'526","reported_seq":561,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.034559+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T22:03:43.034559+0000","last_peered":"2024-04-26T22:03:43.034559+0000","last_clean":"2024-04-26T22:03:43.034559+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T22:03:43.034559+0000","last_undegraded":"2024-04-26T22:03:43.034559+0000","last_fullsized":"2024-04-26T22:03:43.034559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2771","reported_seq":2808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.725372+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T22:03:36.725372+0000","last_peered":"2024-04-26T22:03:36.725372+0000","last_clean":"2024-04-26T22:03:36.725372+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T22:03:36.725372+0000","last_undegraded":"2024-04-26T22:03:36.725372+0000","last_fullsized":"2024-04-26T22:03:36.725372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2771,"log_dups_size":0,"ondisk_log_size":2771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971590,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2774,"num_write_kb":25944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1964","reported_seq":1993,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:34.990272+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T22:03:34.990272+0000","last_peered":"2024-04-26T22:03:34.990272+0000","last_clean":"2024-04-26T22:03:34.990272+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T22:03:34.990272+0000","last_undegraded":"2024-04-26T22:03:34.990272+0000","last_fullsized":"2024-04-26T22:03:34.990272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'495","reported_seq":530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049581+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T22:03:43.049581+0000","last_peered":"2024-04-26T22:03:43.049581+0000","last_clean":"2024-04-26T22:03:43.049581+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T22:03:43.049581+0000","last_undegraded":"2024-04-26T22:03:43.049581+0000","last_fullsized":"2024-04-26T22:03:43.049581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'1459","reported_seq":1496,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:00:39.735974+0000","last_change":"2024-04-26T21:37:16.418849+0000","last_active":"2024-04-26T22:00:39.735974+0000","last_peered":"2024-04-26T22:00:39.735974+0000","last_clean":"2024-04-26T22:00:39.735974+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T22:00:39.735974+0000","last_undegraded":"2024-04-26T22:00:39.735974+0000","last_fullsized":"2024-04-26T22:00:39.735974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1459,"log_dups_size":0,"ondisk_log_size":1459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1458,"num_write_kb":12981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'2194","reported_seq":2224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194184+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T22:03:35.194184+0000","last_peered":"2024-04-26T22:03:35.194184+0000","last_clean":"2024-04-26T22:03:35.194184+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T22:03:35.194184+0000","last_undegraded":"2024-04-26T22:03:35.194184+0000","last_fullsized":"2024-04-26T22:03:35.194184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":50061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'500","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044208+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T22:03:43.044208+0000","last_peered":"2024-04-26T22:03:43.044208+0000","last_clean":"2024-04-26T22:03:43.044208+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T22:03:43.044208+0000","last_undegraded":"2024-04-26T22:03:43.044208+0000","last_fullsized":"2024-04-26T22:03:43.044208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1056","reported_seq":1093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744374+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T22:03:37.744374+0000","last_peered":"2024-04-26T22:03:37.744374+0000","last_clean":"2024-04-26T22:03:37.744374+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T22:03:37.744374+0000","last_undegraded":"2024-04-26T22:03:37.744374+0000","last_fullsized":"2024-04-26T22:03:37.744374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1056,"log_dups_size":0,"ondisk_log_size":1056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":8718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2324","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.179489+0000","last_change":"2024-04-26T21:37:58.755793+0000","last_active":"2024-04-26T22:03:35.179489+0000","last_peered":"2024-04-26T22:03:35.179489+0000","last_clean":"2024-04-26T22:03:35.179489+0000","last_became_active":"2024-04-26T21:37:58.754532+0000","last_became_peered":"2024-04-26T21:37:58.754532+0000","last_unstale":"2024-04-26T22:03:35.179489+0000","last_undegraded":"2024-04-26T22:03:35.179489+0000","last_fullsized":"2024-04-26T22:03:35.179489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:33.156609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":34587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'539","reported_seq":574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043597+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T22:03:43.043597+0000","last_peered":"2024-04-26T22:03:43.043597+0000","last_clean":"2024-04-26T22:03:43.043597+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T22:03:43.043597+0000","last_undegraded":"2024-04-26T22:03:43.043597+0000","last_fullsized":"2024-04-26T22:03:43.043597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'941","reported_seq":978,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.735703+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T22:03:36.735703+0000","last_peered":"2024-04-26T22:03:36.735703+0000","last_clean":"2024-04-26T22:03:36.735703+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T22:03:36.735703+0000","last_undegraded":"2024-04-26T22:03:36.735703+0000","last_fullsized":"2024-04-26T22:03:36.735703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":8676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'1956","reported_seq":1984,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.235647+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T22:03:35.235647+0000","last_peered":"2024-04-26T22:03:35.235647+0000","last_clean":"2024-04-26T22:03:35.235647+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T22:03:35.235647+0000","last_undegraded":"2024-04-26T22:03:35.235647+0000","last_fullsized":"2024-04-26T22:03:35.235647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1956,"log_dups_size":0,"ondisk_log_size":1956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1477,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'502","reported_seq":537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031635+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T22:03:43.031635+0000","last_peered":"2024-04-26T22:03:43.031635+0000","last_clean":"2024-04-26T22:03:43.031635+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T22:03:43.031635+0000","last_undegraded":"2024-04-26T22:03:43.031635+0000","last_fullsized":"2024-04-26T22:03:43.031635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'16","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748578+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T22:03:36.748578+0000","last_peered":"2024-04-26T22:03:36.748578+0000","last_clean":"2024-04-26T22:03:36.748578+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T22:03:36.748578+0000","last_undegraded":"2024-04-26T22:03:36.748578+0000","last_fullsized":"2024-04-26T22:03:36.748578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2142","reported_seq":2170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227910+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T22:03:35.227910+0000","last_peered":"2024-04-26T22:03:35.227910+0000","last_clean":"2024-04-26T22:03:35.227910+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T22:03:35.227910+0000","last_undegraded":"2024-04-26T22:03:35.227910+0000","last_fullsized":"2024-04-26T22:03:35.227910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1648,"num_write_kb":35594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'514","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046487+0000","last_change":"2024-04-26T21:37:58.752144+0000","last_active":"2024-04-26T22:03:43.046487+0000","last_peered":"2024-04-26T22:03:43.046487+0000","last_clean":"2024-04-26T22:03:43.046487+0000","last_became_active":"2024-04-26T21:37:58.751458+0000","last_became_peered":"2024-04-26T21:37:58.751458+0000","last_unstale":"2024-04-26T22:03:43.046487+0000","last_undegraded":"2024-04-26T22:03:43.046487+0000","last_fullsized":"2024-04-26T22:03:43.046487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744268+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T22:03:37.744268+0000","last_peered":"2024-04-26T22:03:37.744268+0000","last_clean":"2024-04-26T22:03:37.744268+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T22:03:37.744268+0000","last_undegraded":"2024-04-26T22:03:37.744268+0000","last_fullsized":"2024-04-26T22:03:37.744268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'2060","reported_seq":2089,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.191326+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T22:03:35.191326+0000","last_peered":"2024-04-26T22:03:35.191326+0000","last_clean":"2024-04-26T22:03:35.191326+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T22:03:35.191326+0000","last_undegraded":"2024-04-26T22:03:35.191326+0000","last_fullsized":"2024-04-26T22:03:35.191326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1564,"num_write_kb":74671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'496","reported_seq":531,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047065+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T22:03:43.047065+0000","last_peered":"2024-04-26T22:03:43.047065+0000","last_clean":"2024-04-26T22:03:43.047065+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T22:03:43.047065+0000","last_undegraded":"2024-04-26T22:03:43.047065+0000","last_fullsized":"2024-04-26T22:03:43.047065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'1736","reported_seq":1773,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:00.173209+0000","last_change":"2024-04-26T21:37:16.434513+0000","last_active":"2024-04-26T22:03:00.173209+0000","last_peered":"2024-04-26T22:03:00.173209+0000","last_clean":"2024-04-26T22:03:00.173209+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T22:03:00.173209+0000","last_undegraded":"2024-04-26T22:03:00.173209+0000","last_fullsized":"2024-04-26T22:03:00.173209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1736,"log_dups_size":0,"ondisk_log_size":1736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1738,"num_write_kb":13055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'1982","reported_seq":2010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.219591+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T22:03:35.219591+0000","last_peered":"2024-04-26T22:03:35.219591+0000","last_clean":"2024-04-26T22:03:35.219591+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T22:03:35.219591+0000","last_undegraded":"2024-04-26T22:03:35.219591+0000","last_fullsized":"2024-04-26T22:03:35.219591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1494,"num_write_kb":56826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'493","reported_seq":527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050223+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T22:03:43.050223+0000","last_peered":"2024-04-26T22:03:43.050223+0000","last_clean":"2024-04-26T22:03:43.050223+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T22:03:43.050223+0000","last_undegraded":"2024-04-26T22:03:43.050223+0000","last_fullsized":"2024-04-26T22:03:43.050223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'2893","reported_seq":2930,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:29.293347+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T22:03:29.293347+0000","last_peered":"2024-04-26T22:03:29.293347+0000","last_clean":"2024-04-26T22:03:29.293347+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T22:03:29.293347+0000","last_undegraded":"2024-04-26T22:03:29.293347+0000","last_fullsized":"2024-04-26T22:03:29.293347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2889,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'2295","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.243563+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T22:03:35.243563+0000","last_peered":"2024-04-26T22:03:35.243563+0000","last_clean":"2024-04-26T22:03:35.243563+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T22:03:35.243563+0000","last_undegraded":"2024-04-26T22:03:35.243563+0000","last_fullsized":"2024-04-26T22:03:35.243563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":114189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'491","reported_seq":526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047946+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T22:03:43.047946+0000","last_peered":"2024-04-26T22:03:43.047946+0000","last_clean":"2024-04-26T22:03:43.047946+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T22:03:43.047946+0000","last_undegraded":"2024-04-26T22:03:43.047946+0000","last_fullsized":"2024-04-26T22:03:43.047946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3654","reported_seq":3690,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:39.737799+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T22:03:39.737799+0000","last_peered":"2024-04-26T22:03:39.737799+0000","last_clean":"2024-04-26T22:03:39.737799+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T22:03:39.737799+0000","last_undegraded":"2024-04-26T22:03:39.737799+0000","last_fullsized":"2024-04-26T22:03:39.737799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3659,"num_write_kb":22929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'2192","reported_seq":2221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186824+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T22:03:35.186824+0000","last_peered":"2024-04-26T22:03:35.186824+0000","last_clean":"2024-04-26T22:03:35.186824+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T22:03:35.186824+0000","last_undegraded":"2024-04-26T22:03:35.186824+0000","last_fullsized":"2024-04-26T22:03:35.186824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2192,"log_dups_size":0,"ondisk_log_size":2192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":143042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'491","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.017358+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T22:03:43.017358+0000","last_peered":"2024-04-26T22:03:43.017358+0000","last_clean":"2024-04-26T22:03:43.017358+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T22:03:43.017358+0000","last_undegraded":"2024-04-26T22:03:43.017358+0000","last_fullsized":"2024-04-26T22:03:43.017358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2006","reported_seq":2042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.737621+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T22:03:35.737621+0000","last_peered":"2024-04-26T22:03:35.737621+0000","last_clean":"2024-04-26T22:03:35.737621+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T22:03:35.737621+0000","last_undegraded":"2024-04-26T22:03:35.737621+0000","last_fullsized":"2024-04-26T22:03:35.737621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":21501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'2154","reported_seq":2183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.152690+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T22:03:35.152690+0000","last_peered":"2024-04-26T22:03:35.152690+0000","last_clean":"2024-04-26T22:03:35.152690+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T22:03:35.152690+0000","last_undegraded":"2024-04-26T22:03:35.152690+0000","last_fullsized":"2024-04-26T22:03:35.152690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1666,"num_write_kb":39964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'495","reported_seq":515,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046220+0000","last_change":"2024-04-26T21:37:58.753596+0000","last_active":"2024-04-26T22:03:43.046220+0000","last_peered":"2024-04-26T22:03:43.046220+0000","last_clean":"2024-04-26T22:03:43.046220+0000","last_became_active":"2024-04-26T21:37:58.752756+0000","last_became_peered":"2024-04-26T21:37:58.752756+0000","last_unstale":"2024-04-26T22:03:43.046220+0000","last_undegraded":"2024-04-26T22:03:43.046220+0000","last_fullsized":"2024-04-26T22:03:43.046220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'566","reported_seq":602,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.749120+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T22:03:36.749120+0000","last_peered":"2024-04-26T22:03:36.749120+0000","last_clean":"2024-04-26T22:03:36.749120+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T22:03:36.749120+0000","last_undegraded":"2024-04-26T22:03:36.749120+0000","last_fullsized":"2024-04-26T22:03:36.749120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'2246","reported_seq":2275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.171910+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T22:03:35.171910+0000","last_peered":"2024-04-26T22:03:35.171910+0000","last_clean":"2024-04-26T22:03:35.171910+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T22:03:35.171910+0000","last_undegraded":"2024-04-26T22:03:35.171910+0000","last_fullsized":"2024-04-26T22:03:35.171910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1740,"num_write_kb":51745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'2287","reported_seq":2318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.733263+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T22:03:35.733263+0000","last_peered":"2024-04-26T22:03:35.733263+0000","last_clean":"2024-04-26T22:03:35.733263+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T22:03:35.733263+0000","last_undegraded":"2024-04-26T22:03:35.733263+0000","last_fullsized":"2024-04-26T22:03:35.733263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1846,"num_write_kb":61262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'494","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.028441+0000","last_change":"2024-04-26T21:37:17.435754+0000","last_active":"2024-04-26T22:03:43.028441+0000","last_peered":"2024-04-26T22:03:43.028441+0000","last_clean":"2024-04-26T22:03:43.028441+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T22:03:43.028441+0000","last_undegraded":"2024-04-26T22:03:43.028441+0000","last_fullsized":"2024-04-26T22:03:43.028441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2601","reported_seq":2637,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.751315+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T22:03:36.751315+0000","last_peered":"2024-04-26T22:03:36.751315+0000","last_clean":"2024-04-26T22:03:36.751315+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T22:03:36.751315+0000","last_undegraded":"2024-04-26T22:03:36.751315+0000","last_fullsized":"2024-04-26T22:03:36.751315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2601,"num_write_kb":21771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'2012","reported_seq":2042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.213549+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T22:03:35.213549+0000","last_peered":"2024-04-26T22:03:35.213549+0000","last_clean":"2024-04-26T22:03:35.213549+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T22:03:35.213549+0000","last_undegraded":"2024-04-26T22:03:35.213549+0000","last_fullsized":"2024-04-26T22:03:35.213549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1553,"num_write_kb":109022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'573","reported_seq":607,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036233+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T22:03:43.036233+0000","last_peered":"2024-04-26T22:03:43.036233+0000","last_clean":"2024-04-26T22:03:43.036233+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T22:03:43.036233+0000","last_undegraded":"2024-04-26T22:03:43.036233+0000","last_fullsized":"2024-04-26T22:03:43.036233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'453","reported_seq":489,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.747058+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T22:03:37.747058+0000","last_peered":"2024-04-26T22:03:37.747058+0000","last_clean":"2024-04-26T22:03:37.747058+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T22:03:37.747058+0000","last_undegraded":"2024-04-26T22:03:37.747058+0000","last_fullsized":"2024-04-26T22:03:37.747058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3504","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750936+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T22:03:37.750936+0000","last_peered":"2024-04-26T22:03:37.750936+0000","last_clean":"2024-04-26T22:03:37.750936+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T22:03:37.750936+0000","last_undegraded":"2024-04-26T22:03:37.750936+0000","last_fullsized":"2024-04-26T22:03:37.750936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3514,"num_write_kb":30405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'488","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047178+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T22:03:43.047178+0000","last_peered":"2024-04-26T22:03:43.047178+0000","last_clean":"2024-04-26T22:03:43.047178+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T22:03:43.047178+0000","last_undegraded":"2024-04-26T22:03:43.047178+0000","last_fullsized":"2024-04-26T22:03:43.047178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'2142","reported_seq":2177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.121545+0000","last_change":"2024-04-26T21:37:59.072851+0000","last_active":"2024-04-26T22:03:35.121545+0000","last_peered":"2024-04-26T22:03:35.121545+0000","last_clean":"2024-04-26T22:03:35.121545+0000","last_became_active":"2024-04-26T21:37:59.071221+0000","last_became_peered":"2024-04-26T21:37:59.071221+0000","last_unstale":"2024-04-26T22:03:35.121545+0000","last_undegraded":"2024-04-26T22:03:35.121545+0000","last_fullsized":"2024-04-26T22:03:35.121545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1199","reported_seq":1235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.748058+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T22:03:37.748058+0000","last_peered":"2024-04-26T22:03:37.748058+0000","last_clean":"2024-04-26T22:03:37.748058+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T22:03:37.748058+0000","last_undegraded":"2024-04-26T22:03:37.748058+0000","last_fullsized":"2024-04-26T22:03:37.748058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'501","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038699+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T22:03:43.038699+0000","last_peered":"2024-04-26T22:03:43.038699+0000","last_clean":"2024-04-26T22:03:43.038699+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T22:03:43.038699+0000","last_undegraded":"2024-04-26T22:03:43.038699+0000","last_fullsized":"2024-04-26T22:03:43.038699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'1931","reported_seq":1959,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.228754+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T22:03:35.228754+0000","last_peered":"2024-04-26T22:03:35.228754+0000","last_clean":"2024-04-26T22:03:35.228754+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T22:03:35.228754+0000","last_undegraded":"2024-04-26T22:03:35.228754+0000","last_fullsized":"2024-04-26T22:03:35.228754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1423,"num_write_kb":55204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'524","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.042836+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T22:03:43.042836+0000","last_peered":"2024-04-26T22:03:43.042836+0000","last_clean":"2024-04-26T22:03:43.042836+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T22:03:43.042836+0000","last_undegraded":"2024-04-26T22:03:43.042836+0000","last_fullsized":"2024-04-26T22:03:43.042836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'551","reported_seq":587,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.023075+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T22:03:43.023075+0000","last_peered":"2024-04-26T22:03:43.023075+0000","last_clean":"2024-04-26T22:03:43.023075+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T22:03:43.023075+0000","last_undegraded":"2024-04-26T22:03:43.023075+0000","last_fullsized":"2024-04-26T22:03:43.023075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:06.431151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'499","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029683+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T22:03:43.029683+0000","last_peered":"2024-04-26T22:03:43.029683+0000","last_clean":"2024-04-26T22:03:43.029683+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T22:03:43.029683+0000","last_undegraded":"2024-04-26T22:03:43.029683+0000","last_fullsized":"2024-04-26T22:03:43.029683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'508","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029954+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T22:03:43.029954+0000","last_peered":"2024-04-26T22:03:43.029954+0000","last_clean":"2024-04-26T22:03:43.029954+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T22:03:43.029954+0000","last_undegraded":"2024-04-26T22:03:43.029954+0000","last_fullsized":"2024-04-26T22:03:43.029954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'476","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045803+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T22:03:43.045803+0000","last_peered":"2024-04-26T22:03:43.045803+0000","last_clean":"2024-04-26T22:03:43.045803+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T22:03:43.045803+0000","last_undegraded":"2024-04-26T22:03:43.045803+0000","last_fullsized":"2024-04-26T22:03:43.045803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'489","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026150+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T22:03:43.026150+0000","last_peered":"2024-04-26T22:03:43.026150+0000","last_clean":"2024-04-26T22:03:43.026150+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T22:03:43.026150+0000","last_undegraded":"2024-04-26T22:03:43.026150+0000","last_fullsized":"2024-04-26T22:03:43.026150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'522","reported_seq":558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050293+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T22:03:43.050293+0000","last_peered":"2024-04-26T22:03:43.050293+0000","last_clean":"2024-04-26T22:03:43.050293+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T22:03:43.050293+0000","last_undegraded":"2024-04-26T22:03:43.050293+0000","last_fullsized":"2024-04-26T22:03:43.050293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'475","reported_seq":511,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047218+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T22:03:43.047218+0000","last_peered":"2024-04-26T22:03:43.047218+0000","last_clean":"2024-04-26T22:03:43.047218+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T22:03:43.047218+0000","last_undegraded":"2024-04-26T22:03:43.047218+0000","last_fullsized":"2024-04-26T22:03:43.047218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'513","reported_seq":534,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031332+0000","last_change":"2024-04-26T21:37:58.751645+0000","last_active":"2024-04-26T22:03:43.031332+0000","last_peered":"2024-04-26T22:03:43.031332+0000","last_clean":"2024-04-26T22:03:43.031332+0000","last_became_active":"2024-04-26T21:37:58.749833+0000","last_became_peered":"2024-04-26T21:37:58.749833+0000","last_unstale":"2024-04-26T22:03:43.031332+0000","last_undegraded":"2024-04-26T22:03:43.031332+0000","last_fullsized":"2024-04-26T22:03:43.031332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:15.821911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"26'482","reported_seq":517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045694+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T22:03:43.045694+0000","last_peered":"2024-04-26T22:03:43.045694+0000","last_clean":"2024-04-26T22:03:43.045694+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T22:03:43.045694+0000","last_undegraded":"2024-04-26T22:03:43.045694+0000","last_fullsized":"2024-04-26T22:03:43.045694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'530","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047951+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T22:03:43.047951+0000","last_peered":"2024-04-26T22:03:43.047951+0000","last_clean":"2024-04-26T22:03:43.047951+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T22:03:43.047951+0000","last_undegraded":"2024-04-26T22:03:43.047951+0000","last_fullsized":"2024-04-26T22:03:43.047951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'488","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047329+0000","last_change":"2024-04-26T21:37:17.439778+0000","last_active":"2024-04-26T22:03:43.047329+0000","last_peered":"2024-04-26T22:03:43.047329+0000","last_clean":"2024-04-26T22:03:43.047329+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T22:03:43.047329+0000","last_undegraded":"2024-04-26T22:03:43.047329+0000","last_fullsized":"2024-04-26T22:03:43.047329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'512","reported_seq":547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044243+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T22:03:43.044243+0000","last_peered":"2024-04-26T22:03:43.044243+0000","last_clean":"2024-04-26T22:03:43.044243+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T22:03:43.044243+0000","last_undegraded":"2024-04-26T22:03:43.044243+0000","last_fullsized":"2024-04-26T22:03:43.044243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'505","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049561+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T22:03:43.049561+0000","last_peered":"2024-04-26T22:03:43.049561+0000","last_clean":"2024-04-26T22:03:43.049561+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T22:03:43.049561+0000","last_undegraded":"2024-04-26T22:03:43.049561+0000","last_fullsized":"2024-04-26T22:03:43.049561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'459","reported_seq":494,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039316+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T22:03:43.039316+0000","last_peered":"2024-04-26T22:03:43.039316+0000","last_clean":"2024-04-26T22:03:43.039316+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T22:03:43.039316+0000","last_undegraded":"2024-04-26T22:03:43.039316+0000","last_fullsized":"2024-04-26T22:03:43.039316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:34.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'525","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050851+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T22:03:43.050851+0000","last_peered":"2024-04-26T22:03:43.050851+0000","last_clean":"2024-04-26T22:03:43.050851+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T22:03:43.050851+0000","last_undegraded":"2024-04-26T22:03:43.050851+0000","last_fullsized":"2024-04-26T22:03:43.050851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'520","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037528+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T22:03:43.037528+0000","last_peered":"2024-04-26T22:03:43.037528+0000","last_clean":"2024-04-26T22:03:43.037528+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T22:03:43.037528+0000","last_undegraded":"2024-04-26T22:03:43.037528+0000","last_fullsized":"2024-04-26T22:03:43.037528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'505","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.022688+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T22:03:43.022688+0000","last_peered":"2024-04-26T22:03:43.022688+0000","last_clean":"2024-04-26T22:03:43.022688+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T22:03:43.022688+0000","last_undegraded":"2024-04-26T22:03:43.022688+0000","last_fullsized":"2024-04-26T22:03:43.022688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'510","reported_seq":545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035772+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T22:03:43.035772+0000","last_peered":"2024-04-26T22:03:43.035772+0000","last_clean":"2024-04-26T22:03:43.035772+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T22:03:43.035772+0000","last_undegraded":"2024-04-26T22:03:43.035772+0000","last_fullsized":"2024-04-26T22:03:43.035772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:38.335510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'476","reported_seq":510,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035648+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T22:03:43.035648+0000","last_peered":"2024-04-26T22:03:43.035648+0000","last_clean":"2024-04-26T22:03:43.035648+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T22:03:43.035648+0000","last_undegraded":"2024-04-26T22:03:43.035648+0000","last_fullsized":"2024-04-26T22:03:43.035648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'494","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037947+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T22:03:43.037947+0000","last_peered":"2024-04-26T22:03:43.037947+0000","last_clean":"2024-04-26T22:03:43.037947+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T22:03:43.037947+0000","last_undegraded":"2024-04-26T22:03:43.037947+0000","last_fullsized":"2024-04-26T22:03:43.037947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'475","reported_seq":509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032023+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T22:03:43.032023+0000","last_peered":"2024-04-26T22:03:43.032023+0000","last_clean":"2024-04-26T22:03:43.032023+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T22:03:43.032023+0000","last_undegraded":"2024-04-26T22:03:43.032023+0000","last_fullsized":"2024-04-26T22:03:43.032023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049937+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T22:03:43.049937+0000","last_peered":"2024-04-26T22:03:43.049937+0000","last_clean":"2024-04-26T22:03:43.049937+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T22:03:43.049937+0000","last_undegraded":"2024-04-26T22:03:43.049937+0000","last_fullsized":"2024-04-26T22:03:43.049937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'506","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051623+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T22:03:43.051623+0000","last_peered":"2024-04-26T22:03:43.051623+0000","last_clean":"2024-04-26T22:03:43.051623+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T22:03:43.051623+0000","last_undegraded":"2024-04-26T22:03:43.051623+0000","last_fullsized":"2024-04-26T22:03:43.051623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'470","reported_seq":490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.024943+0000","last_change":"2024-04-26T21:37:59.071288+0000","last_active":"2024-04-26T22:03:43.024943+0000","last_peered":"2024-04-26T22:03:43.024943+0000","last_clean":"2024-04-26T22:03:43.024943+0000","last_became_active":"2024-04-26T21:37:59.070372+0000","last_became_peered":"2024-04-26T21:37:59.070372+0000","last_unstale":"2024-04-26T22:03:43.024943+0000","last_undegraded":"2024-04-26T22:03:43.024943+0000","last_fullsized":"2024-04-26T22:03:43.024943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037366+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T22:03:43.037366+0000","last_peered":"2024-04-26T22:03:43.037366+0000","last_clean":"2024-04-26T22:03:43.037366+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T22:03:43.037366+0000","last_undegraded":"2024-04-26T22:03:43.037366+0000","last_fullsized":"2024-04-26T22:03:43.037366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'482","reported_seq":516,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038091+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T22:03:43.038091+0000","last_peered":"2024-04-26T22:03:43.038091+0000","last_clean":"2024-04-26T22:03:43.038091+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T22:03:43.038091+0000","last_undegraded":"2024-04-26T22:03:43.038091+0000","last_fullsized":"2024-04-26T22:03:43.038091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'509","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044575+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T22:03:43.044575+0000","last_peered":"2024-04-26T22:03:43.044575+0000","last_clean":"2024-04-26T22:03:43.044575+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T22:03:43.044575+0000","last_undegraded":"2024-04-26T22:03:43.044575+0000","last_fullsized":"2024-04-26T22:03:43.044575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'509","reported_seq":546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036324+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T22:03:43.036324+0000","last_peered":"2024-04-26T22:03:43.036324+0000","last_clean":"2024-04-26T22:03:43.036324+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T22:03:43.036324+0000","last_undegraded":"2024-04-26T22:03:43.036324+0000","last_fullsized":"2024-04-26T22:03:43.036324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'488","reported_seq":524,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026593+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T22:03:43.026593+0000","last_peered":"2024-04-26T22:03:43.026593+0000","last_clean":"2024-04-26T22:03:43.026593+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T22:03:43.026593+0000","last_undegraded":"2024-04-26T22:03:43.026593+0000","last_fullsized":"2024-04-26T22:03:43.026593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'487","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035868+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T22:03:43.035868+0000","last_peered":"2024-04-26T22:03:43.035868+0000","last_clean":"2024-04-26T22:03:43.035868+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T22:03:43.035868+0000","last_undegraded":"2024-04-26T22:03:43.035868+0000","last_fullsized":"2024-04-26T22:03:43.035868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'477","reported_seq":513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050222+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T22:03:43.050222+0000","last_peered":"2024-04-26T22:03:43.050222+0000","last_clean":"2024-04-26T22:03:43.050222+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T22:03:43.050222+0000","last_undegraded":"2024-04-26T22:03:43.050222+0000","last_fullsized":"2024-04-26T22:03:43.050222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52831,"num_write_kb":2071742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68463,"ondisk_log_size":68463,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31956,"ondisk_log_size":31956,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":240165372,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":58367,"num_write_kb":440918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":480387072,"data_stored":480330744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55417,"ondisk_log_size":55417,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575171,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279712,"kb_used_data":50008,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94092128,"statfs":{"total":96636764160,"available":96350339072,"internally_reserved":0,"allocated":51208192,"data_stored":51036951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325156,"kb_used_data":63580,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94046684,"statfs":{"total":96636764160,"available":96303804416,"internally_reserved":0,"allocated":65105920,"data_stored":64933386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575172,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":69908,"kb_used_omap":1,"kb_used_meta":233726,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":71585792,"data_stored":71417611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239335877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575172,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309348,"kb_used_data":65820,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94062492,"statfs":{"total":96636764160,"available":96319991808,"internally_reserved":0,"allocated":67399680,"data_stored":67223343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249362886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575171,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397252,"kb_used_data":73212,"kb_used_omap":1,"kb_used_meta":324030,"kb_avail":93974588,"statfs":{"total":96636764160,"available":96229978112,"internally_reserved":0,"allocated":74969088,"data_stored":74797270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":331807175},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575173,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211836,"kb_used_data":36340,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94160004,"statfs":{"total":96636764160,"available":96419844096,"internally_reserved":0,"allocated":37212160,"data_stored":37047862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575173,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":427684,"kb_used_data":75868,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93944156,"statfs":{"total":96636764160,"available":96198815744,"internally_reserved":0,"allocated":77688832,"data_stored":77515786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257640,"kb_used_data":37728,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94114200,"statfs":{"total":96636764160,"available":96372940800,"internally_reserved":0,"allocated":38633472,"data_stored":38454095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225180102},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77410304,"data_stored":77401433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36933632,"data_stored":36933509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74690560,"data_stored":74682917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":67121152,"data_stored":67108990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64827392,"data_stored":64819033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:03:50.429 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T22:03:50.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:03:50.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.681+0000 7ff25ae00640 1 Processor -- start 2024-04-26T22:03:50.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.681+0000 7ff25ae00640 1 -- start start 2024-04-26T22:03:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.682+0000 7ff25ae00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2540aea80 0x7ff25414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.682+0000 7ff25ae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2540aee60 con 0x7ff2540af9b0 2024-04-26T22:03:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.682+0000 7ff25ae00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2540b11f0 con 0x7ff254149600 2024-04-26T22:03:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.682+0000 7ff25ae00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff2540b70b0 con 0x7ff2540aea80 2024-04-26T22:03:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.683+0000 7ff253400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2540af9b0 0x7ff254148ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48466/0 (socket says 172.21.15.5:48466) 2024-04-26T22:03:50.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.683+0000 7ff253400640 1 -- 172.21.15.5:0/1411198322 learned_addr learned my addr 172.21.15.5:0/1411198322 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.683+0000 7ff253e00640 1 --2- 172.21.15.5:0/1411198322 >> v2:172.21.15.112:3300/0 conn(0x7ff2540aea80 0x7ff25414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.683+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173470472 0 0) 0x7ff2540aee60 con 0x7ff2540af9b0 2024-04-26T22:03:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.683+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff238003520 con 0x7ff2540af9b0 2024-04-26T22:03:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3349627604 0 0) 0x7ff238003520 con 0x7ff2540af9b0 2024-04-26T22:03:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 >> v2:172.21.15.112:3300/0 conn(0x7ff2540aea80 msgr2=0x7ff25414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 --2- 172.21.15.5:0/1411198322 >> v2:172.21.15.112:3300/0 conn(0x7ff2540aea80 0x7ff25414bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 >> v1:172.21.15.112:6789/0 conn(0x7ff254149600 legacy=0x7ff254152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2540af490 con 0x7ff2540af9b0 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7ff240001670 con 0x7ff2540af9b0 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 >> v1:172.21.15.5:6789/0 conn(0x7ff2540af9b0 legacy=0x7ff254148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238003a00 0x7ff238003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff238004800 0x7ff238004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238005210 0x7ff23800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2540b70b0 con 0x7ff238003a00 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff23800c160 con 0x7ff238005210 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff23800c360 con 0x7ff238004800 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff253e00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238003a00 0x7ff238003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff258e00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238005210 0x7ff23800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff253e00640 1 -- 172.21.15.5:0/1411198322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff238004800 msgr2=0x7ff238004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.684+0000 7ff253e00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff238004800 0x7ff238004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.685+0000 7ff253e00640 1 -- 172.21.15.5:0/1411198322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238005210 msgr2=0x7ff23800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.685+0000 7ff253e00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238005210 0x7ff23800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.685+0000 7ff253e00640 1 -- 172.21.15.5:0/1411198322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff238003520 con 0x7ff238003a00 2024-04-26T22:03:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.685+0000 7ff258e00640 1 -- 172.21.15.5:0/1411198322 reap_dead start 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff253e00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238003a00 0x7ff238003e20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff244009a90 tx=0x7ff238005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecaa532f9203e59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244036070 con 0x7ff238003a00 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff244031400 con 0x7ff238003a00 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff252a00640 1 -- 172.21.15.5:0/1411198322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244009690 con 0x7ff238003a00 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff25ae00640 1 -- 172.21.15.5:0/1411198322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238003a00 msgr2=0x7ff238003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff25ae00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238003a00 0x7ff238003e20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff244009a90 tx=0x7ff238005830 comp rx=0 tx=0).stop 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff25ae00640 1 -- 172.21.15.5:0/1411198322 shutdown_connections 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff25ae00640 1 --2- 172.21.15.5:0/1411198322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff238003a00 0x7ff238003e20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.686+0000 7ff25ae00640 1 -- 172.21.15.5:0/1411198322 >> 172.21.15.5:0/1411198322 conn(0x7ff25406c4e0 msgr2=0x7ff25406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.687+0000 7ff25ae00640 1 -- 172.21.15.5:0/1411198322 shutdown_connections 2024-04-26T22:03:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.687+0000 7ff25ae00640 1 -- 172.21.15.5:0/1411198322 wait complete. 2024-04-26T22:03:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.688+0000 7ff25ae00640 1 Processor -- start 2024-04-26T22:03:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.688+0000 7ff25ae00640 1 -- start start 2024-04-26T22:03:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff25ae00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238003a00 0x7ff2541de1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff25ae00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254073460 0x7ff254070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff25ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541de970 0x7ff2541dedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff25ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2540b0a80 con 0x7ff2541de970 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff25ae00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2540b6d20 con 0x7ff238003a00 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff25ae00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff254148ef0 con 0x7ff254073460 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff258e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541de970 0x7ff2541dedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff258e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541de970 0x7ff2541dedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34188/0 (socket says 172.21.15.5:34188) 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.689+0000 7ff258e00640 1 -- 172.21.15.5:0/3841402949 learned_addr learned my addr 172.21.15.5:0/3841402949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff253e00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238003a00 0x7ff2541de1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff253400640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254073460 0x7ff254070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff258e00640 1 -- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254073460 msgr2=0x7ff254070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff258e00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254073460 0x7ff254070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff258e00640 1 -- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238003a00 msgr2=0x7ff2541de1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff258e00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238003a00 0x7ff2541de1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff258e00640 1 -- 172.21.15.5:0/3841402949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff254072cd0 con 0x7ff2541de970 2024-04-26T22:03:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff258e00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541de970 0x7ff2541dedf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2540b5c20 tx=0x7ff24c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:50.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.690+0000 7ff24be00640 1 -- 172.21.15.5:0/3841402949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c018070 con 0x7ff2541de970 2024-04-26T22:03:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.691+0000 7ff24be00640 1 -- 172.21.15.5:0/3841402949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c003b70 con 0x7ff2541de970 2024-04-26T22:03:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.691+0000 7ff24be00640 1 -- 172.21.15.5:0/3841402949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c005070 con 0x7ff2541de970 2024-04-26T22:03:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.691+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff254071810 con 0x7ff2541de970 2024-04-26T22:03:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.691+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff254144960 con 0x7ff2541de970 2024-04-26T22:03:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.692+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff254075db0 con 0x7ff2541de970 2024-04-26T22:03:50.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.693+0000 7ff24be00640 1 -- 172.21.15.5:0/3841402949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff24c01b070 con 0x7ff2541de970 2024-04-26T22:03:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.694+0000 7ff24be00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c920 0x7ff23406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.694+0000 7ff24be00640 1 -- 172.21.15.5:0/3841402949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff24c08b5a0 con 0x7ff2541de970 2024-04-26T22:03:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.694+0000 7ff253e00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c920 0x7ff23406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.696+0000 7ff253e00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c920 0x7ff23406ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff244033000 tx=0x7ff244008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:50.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.698+0000 7ff24be00640 1 -- 172.21.15.5:0/3841402949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff24c0015b0 con 0x7ff2541de970 2024-04-26T22:03:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.897+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff254073840 con 0x7ff23406c920 2024-04-26T22:03:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.922+0000 7ff24be00640 1 -- 172.21.15.5:0/3841402949 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334697 (secure 0 0 0) 0x7ff254073840 con 0x7ff23406c920 2024-04-26T22:03:50.926 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:03:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T22:03:50.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.930+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c920 msgr2=0x7ff23406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.930+0000 7ff25ae00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c920 0x7ff23406ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff244033000 tx=0x7ff244008030 comp rx=0 tx=0).stop 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.930+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541de970 msgr2=0x7ff2541dedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.930+0000 7ff25ae00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541de970 0x7ff2541dedf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2540b5c20 tx=0x7ff24c00dc00 comp rx=0 tx=0).stop 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.930+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 shutdown_connections 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.930+0000 7ff25ae00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff23406c920 0x7ff23406ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.930+0000 7ff25ae00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2541de970 0x7ff2541dedf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.931+0000 7ff25ae00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff254073460 0x7ff254070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.931+0000 7ff25ae00640 1 --2- 172.21.15.5:0/3841402949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff238003a00 0x7ff2541de1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.931+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 >> 172.21.15.5:0/3841402949 conn(0x7ff25406c4e0 msgr2=0x7ff2540b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.931+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 shutdown_connections 2024-04-26T22:03:50.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:50.931+0000 7ff25ae00640 1 -- 172.21.15.5:0/3841402949 wait complete. 2024-04-26T22:03:50.950 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":822,"stamp":"2024-04-26T22:03:50.097800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240755740,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2795,"num_read_kb":5345,"num_write":112477,"num_write_kb":2515076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155953,"ondisk_log_size":155953,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2512272,"kb_used_data":472464,"kb_used_omap":12,"kb_used_meta":2039731,"kb_avail":752462448,"statfs":{"total":773094113280,"available":770521546752,"internally_reserved":0,"allocated":483803136,"data_stored":482426304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2088685108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-93602810,"num_objects":-644,"num_object_clones":0,"num_object_copies":-1874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-644,"num_whiteouts":0,"num_read":12,"num_read_kb":43,"num_write":694,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005147"},"pg_stats":[{"pgid":"2.1f","version":"26'1240","reported_seq":1278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.748279+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T22:03:37.748279+0000","last_peered":"2024-04-26T22:03:37.748279+0000","last_clean":"2024-04-26T22:03:37.748279+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T22:03:37.748279+0000","last_undegraded":"2024-04-26T22:03:37.748279+0000","last_fullsized":"2024-04-26T22:03:37.748279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:32.834699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'475","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032915+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T22:03:43.032915+0000","last_peered":"2024-04-26T22:03:43.032915+0000","last_clean":"2024-04-26T22:03:43.032915+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T22:03:43.032915+0000","last_undegraded":"2024-04-26T22:03:43.032915+0000","last_fullsized":"2024-04-26T22:03:43.032915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'1944","reported_seq":1972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.226697+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T22:03:35.226697+0000","last_peered":"2024-04-26T22:03:35.226697+0000","last_clean":"2024-04-26T22:03:35.226697+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T22:03:35.226697+0000","last_undegraded":"2024-04-26T22:03:35.226697+0000","last_fullsized":"2024-04-26T22:03:35.226697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1944,"log_dups_size":0,"ondisk_log_size":1944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":38072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3188","reported_seq":3227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746607+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T22:03:37.746607+0000","last_peered":"2024-04-26T22:03:37.746607+0000","last_clean":"2024-04-26T22:03:37.746607+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T22:03:37.746607+0000","last_undegraded":"2024-04-26T22:03:37.746607+0000","last_fullsized":"2024-04-26T22:03:37.746607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3196,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'472","reported_seq":508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.017603+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T22:03:43.017603+0000","last_peered":"2024-04-26T22:03:43.017603+0000","last_clean":"2024-04-26T22:03:43.017603+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T22:03:43.017603+0000","last_undegraded":"2024-04-26T22:03:43.017603+0000","last_fullsized":"2024-04-26T22:03:43.017603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2092","reported_seq":2120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194904+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T22:03:35.194904+0000","last_peered":"2024-04-26T22:03:35.194904+0000","last_clean":"2024-04-26T22:03:35.194904+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T22:03:35.194904+0000","last_undegraded":"2024-04-26T22:03:35.194904+0000","last_fullsized":"2024-04-26T22:03:35.194904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":42136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3681","reported_seq":3717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.754029+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T22:03:36.754029+0000","last_peered":"2024-04-26T22:03:36.754029+0000","last_clean":"2024-04-26T22:03:36.754029+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T22:03:36.754029+0000","last_undegraded":"2024-04-26T22:03:36.754029+0000","last_fullsized":"2024-04-26T22:03:36.754029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3687,"num_write_kb":30415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'531","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.040634+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T22:03:43.040634+0000","last_peered":"2024-04-26T22:03:43.040634+0000","last_clean":"2024-04-26T22:03:43.040634+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T22:03:43.040634+0000","last_undegraded":"2024-04-26T22:03:43.040634+0000","last_fullsized":"2024-04-26T22:03:43.040634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'2113","reported_seq":2148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.137495+0000","last_change":"2024-04-26T21:37:58.756041+0000","last_active":"2024-04-26T22:03:35.137495+0000","last_peered":"2024-04-26T22:03:35.137495+0000","last_clean":"2024-04-26T22:03:35.137495+0000","last_became_active":"2024-04-26T21:37:58.754696+0000","last_became_peered":"2024-04-26T21:37:58.754696+0000","last_unstale":"2024-04-26T22:03:35.137495+0000","last_undegraded":"2024-04-26T22:03:35.137495+0000","last_fullsized":"2024-04-26T22:03:35.137495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:14.032751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1612,"num_write_kb":85113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'411","reported_seq":447,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746921+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T22:03:36.746921+0000","last_peered":"2024-04-26T22:03:36.746921+0000","last_clean":"2024-04-26T22:03:36.746921+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T22:03:36.746921+0000","last_undegraded":"2024-04-26T22:03:36.746921+0000","last_fullsized":"2024-04-26T22:03:36.746921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039133+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T22:03:43.039133+0000","last_peered":"2024-04-26T22:03:43.039133+0000","last_clean":"2024-04-26T22:03:43.039133+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T22:03:43.039133+0000","last_undegraded":"2024-04-26T22:03:43.039133+0000","last_fullsized":"2024-04-26T22:03:43.039133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'2117","reported_seq":2145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233562+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T22:03:35.233562+0000","last_peered":"2024-04-26T22:03:35.233562+0000","last_clean":"2024-04-26T22:03:35.233562+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T22:03:35.233562+0000","last_undegraded":"2024-04-26T22:03:35.233562+0000","last_fullsized":"2024-04-26T22:03:35.233562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2117,"log_dups_size":0,"ondisk_log_size":2117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1631,"num_write_kb":60261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'502","reported_seq":538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043741+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T22:03:43.043741+0000","last_peered":"2024-04-26T22:03:43.043741+0000","last_clean":"2024-04-26T22:03:43.043741+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T22:03:43.043741+0000","last_undegraded":"2024-04-26T22:03:43.043741+0000","last_fullsized":"2024-04-26T22:03:43.043741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'2421","reported_seq":2458,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750510+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T22:03:37.750510+0000","last_peered":"2024-04-26T22:03:37.750510+0000","last_clean":"2024-04-26T22:03:37.750510+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T22:03:37.750510+0000","last_undegraded":"2024-04-26T22:03:37.750510+0000","last_fullsized":"2024-04-26T22:03:37.750510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2421,"log_dups_size":0,"ondisk_log_size":2421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":21667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'2164","reported_seq":2193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.113767+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T22:03:35.113767+0000","last_peered":"2024-04-26T22:03:35.113767+0000","last_clean":"2024-04-26T22:03:35.113767+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T22:03:35.113767+0000","last_undegraded":"2024-04-26T22:03:35.113767+0000","last_fullsized":"2024-04-26T22:03:35.113767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2164,"log_dups_size":0,"ondisk_log_size":2164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1702,"num_write_kb":82391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'487","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035776+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T22:03:43.035776+0000","last_peered":"2024-04-26T22:03:43.035776+0000","last_clean":"2024-04-26T22:03:43.035776+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T22:03:43.035776+0000","last_undegraded":"2024-04-26T22:03:43.035776+0000","last_fullsized":"2024-04-26T22:03:43.035776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'2546","reported_seq":2584,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744390+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T22:03:37.744390+0000","last_peered":"2024-04-26T22:03:37.744390+0000","last_clean":"2024-04-26T22:03:37.744390+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T22:03:37.744390+0000","last_undegraded":"2024-04-26T22:03:37.744390+0000","last_fullsized":"2024-04-26T22:03:37.744390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2556,"num_write_kb":21644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'2346","reported_seq":2375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.178720+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T22:03:35.178720+0000","last_peered":"2024-04-26T22:03:35.178720+0000","last_clean":"2024-04-26T22:03:35.178720+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T22:03:35.178720+0000","last_undegraded":"2024-04-26T22:03:35.178720+0000","last_fullsized":"2024-04-26T22:03:35.178720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2346,"log_dups_size":0,"ondisk_log_size":2346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1850,"num_write_kb":43022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'518","reported_seq":554,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032499+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T22:03:43.032499+0000","last_peered":"2024-04-26T22:03:43.032499+0000","last_clean":"2024-04-26T22:03:43.032499+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T22:03:43.032499+0000","last_undegraded":"2024-04-26T22:03:43.032499+0000","last_fullsized":"2024-04-26T22:03:43.032499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'925","reported_seq":963,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:19.800121+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T22:03:19.800121+0000","last_peered":"2024-04-26T22:03:19.800121+0000","last_clean":"2024-04-26T22:03:19.800121+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T22:03:19.800121+0000","last_undegraded":"2024-04-26T22:03:19.800121+0000","last_fullsized":"2024-04-26T22:03:19.800121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":8623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'2213","reported_seq":2242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.222029+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T22:03:35.222029+0000","last_peered":"2024-04-26T22:03:35.222029+0000","last_clean":"2024-04-26T22:03:35.222029+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T22:03:35.222029+0000","last_undegraded":"2024-04-26T22:03:35.222029+0000","last_fullsized":"2024-04-26T22:03:35.222029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2213,"log_dups_size":0,"ondisk_log_size":2213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":80555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.201419+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T22:03:35.201419+0000","last_peered":"2024-04-26T22:03:35.201419+0000","last_clean":"2024-04-26T22:03:35.201419+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T22:03:35.201419+0000","last_undegraded":"2024-04-26T22:03:35.201419+0000","last_fullsized":"2024-04-26T22:03:35.201419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'481","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746018+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T22:03:37.746018+0000","last_peered":"2024-04-26T22:03:37.746018+0000","last_clean":"2024-04-26T22:03:37.746018+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T22:03:37.746018+0000","last_undegraded":"2024-04-26T22:03:37.746018+0000","last_fullsized":"2024-04-26T22:03:37.746018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'1921","reported_seq":1950,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233522+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T22:03:35.233522+0000","last_peered":"2024-04-26T22:03:35.233522+0000","last_clean":"2024-04-26T22:03:35.233522+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T22:03:35.233522+0000","last_undegraded":"2024-04-26T22:03:35.233522+0000","last_fullsized":"2024-04-26T22:03:35.233522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'497","reported_seq":533,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031790+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T22:03:43.031790+0000","last_peered":"2024-04-26T22:03:43.031790+0000","last_clean":"2024-04-26T22:03:43.031790+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T22:03:43.031790+0000","last_undegraded":"2024-04-26T22:03:43.031790+0000","last_fullsized":"2024-04-26T22:03:43.031790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'397","reported_seq":435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.753663+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T22:03:37.753663+0000","last_peered":"2024-04-26T22:03:37.753663+0000","last_clean":"2024-04-26T22:03:37.753663+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T22:03:37.753663+0000","last_undegraded":"2024-04-26T22:03:37.753663+0000","last_fullsized":"2024-04-26T22:03:37.753663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'2230","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082241+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T22:03:35.082241+0000","last_peered":"2024-04-26T22:03:35.082241+0000","last_clean":"2024-04-26T22:03:35.082241+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T22:03:35.082241+0000","last_undegraded":"2024-04-26T22:03:35.082241+0000","last_fullsized":"2024-04-26T22:03:35.082241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2230,"log_dups_size":0,"ondisk_log_size":2230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":137897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'453","reported_seq":489,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049286+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T22:03:43.049286+0000","last_peered":"2024-04-26T22:03:43.049286+0000","last_clean":"2024-04-26T22:03:43.049286+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T22:03:43.049286+0000","last_undegraded":"2024-04-26T22:03:43.049286+0000","last_fullsized":"2024-04-26T22:03:43.049286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1575","reported_seq":1613,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.395295+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T22:03:43.395295+0000","last_peered":"2024-04-26T22:03:43.395295+0000","last_clean":"2024-04-26T22:03:43.395295+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T22:03:43.395295+0000","last_undegraded":"2024-04-26T22:03:43.395295+0000","last_fullsized":"2024-04-26T22:03:43.395295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903801,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4315,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'1970","reported_seq":2001,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227988+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T22:03:35.227988+0000","last_peered":"2024-04-26T22:03:35.227988+0000","last_clean":"2024-04-26T22:03:35.227988+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T22:03:35.227988+0000","last_undegraded":"2024-04-26T22:03:35.227988+0000","last_fullsized":"2024-04-26T22:03:35.227988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1970,"log_dups_size":0,"ondisk_log_size":1970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":39987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'506","reported_seq":542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.019974+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T22:03:43.019974+0000","last_peered":"2024-04-26T22:03:43.019974+0000","last_clean":"2024-04-26T22:03:43.019974+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T22:03:43.019974+0000","last_undegraded":"2024-04-26T22:03:43.019974+0000","last_fullsized":"2024-04-26T22:03:43.019974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2119","reported_seq":2157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748733+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T22:03:36.748733+0000","last_peered":"2024-04-26T22:03:36.748733+0000","last_clean":"2024-04-26T22:03:36.748733+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T22:03:36.748733+0000","last_undegraded":"2024-04-26T22:03:36.748733+0000","last_fullsized":"2024-04-26T22:03:36.748733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2119,"log_dups_size":0,"ondisk_log_size":2119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2125,"num_write_kb":17294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2154","reported_seq":2184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.006513+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T22:03:35.006513+0000","last_peered":"2024-04-26T22:03:35.006513+0000","last_clean":"2024-04-26T22:03:35.006513+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T22:03:35.006513+0000","last_undegraded":"2024-04-26T22:03:35.006513+0000","last_fullsized":"2024-04-26T22:03:35.006513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1661,"num_write_kb":51179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'504","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029821+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T22:03:43.029821+0000","last_peered":"2024-04-26T22:03:43.029821+0000","last_clean":"2024-04-26T22:03:43.029821+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T22:03:43.029821+0000","last_undegraded":"2024-04-26T22:03:43.029821+0000","last_fullsized":"2024-04-26T22:03:43.029821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'363","reported_seq":401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.742937+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T22:03:37.742937+0000","last_peered":"2024-04-26T22:03:37.742937+0000","last_clean":"2024-04-26T22:03:37.742937+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T22:03:37.742937+0000","last_undegraded":"2024-04-26T22:03:37.742937+0000","last_fullsized":"2024-04-26T22:03:37.742937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'2388","reported_seq":2418,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.178286+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T22:03:35.178286+0000","last_peered":"2024-04-26T22:03:35.178286+0000","last_clean":"2024-04-26T22:03:35.178286+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T22:03:35.178286+0000","last_undegraded":"2024-04-26T22:03:35.178286+0000","last_fullsized":"2024-04-26T22:03:35.178286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2388,"log_dups_size":0,"ondisk_log_size":2388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":100197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035449+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T22:03:43.035449+0000","last_peered":"2024-04-26T22:03:43.035449+0000","last_clean":"2024-04-26T22:03:43.035449+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T22:03:43.035449+0000","last_undegraded":"2024-04-26T22:03:43.035449+0000","last_fullsized":"2024-04-26T22:03:43.035449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'2499","reported_seq":2537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746933+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T22:03:36.746933+0000","last_peered":"2024-04-26T22:03:36.746933+0000","last_clean":"2024-04-26T22:03:36.746933+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T22:03:36.746933+0000","last_undegraded":"2024-04-26T22:03:36.746933+0000","last_fullsized":"2024-04-26T22:03:36.746933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2499,"log_dups_size":0,"ondisk_log_size":2499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2501,"num_write_kb":21681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2296","reported_seq":2326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.238210+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T22:03:35.238210+0000","last_peered":"2024-04-26T22:03:35.238210+0000","last_clean":"2024-04-26T22:03:35.238210+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T22:03:35.238210+0000","last_undegraded":"2024-04-26T22:03:35.238210+0000","last_fullsized":"2024-04-26T22:03:35.238210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1815,"num_write_kb":51574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'506","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.021708+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T22:03:43.021708+0000","last_peered":"2024-04-26T22:03:43.021708+0000","last_clean":"2024-04-26T22:03:43.021708+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T22:03:43.021708+0000","last_undegraded":"2024-04-26T22:03:43.021708+0000","last_fullsized":"2024-04-26T22:03:43.021708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4043","reported_seq":6760,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.743148+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T22:03:43.743148+0000","last_peered":"2024-04-26T22:03:43.743148+0000","last_clean":"2024-04-26T22:03:43.743148+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T22:03:43.743148+0000","last_undegraded":"2024-04-26T22:03:43.743148+0000","last_fullsized":"2024-04-26T22:03:43.743148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15961989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":4049,"num_write_kb":18210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'1988","reported_seq":2018,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.245965+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T22:03:35.245965+0000","last_peered":"2024-04-26T22:03:35.245965+0000","last_clean":"2024-04-26T22:03:35.245965+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T22:03:35.245965+0000","last_undegraded":"2024-04-26T22:03:35.245965+0000","last_fullsized":"2024-04-26T22:03:35.245965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":88301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'487","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.040601+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T22:03:43.040601+0000","last_peered":"2024-04-26T22:03:43.040601+0000","last_clean":"2024-04-26T22:03:43.040601+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T22:03:43.040601+0000","last_undegraded":"2024-04-26T22:03:43.040601+0000","last_fullsized":"2024-04-26T22:03:43.040601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:03.104148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'2390","reported_seq":2429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746379+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T22:03:36.746379+0000","last_peered":"2024-04-26T22:03:36.746379+0000","last_clean":"2024-04-26T22:03:36.746379+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T22:03:36.746379+0000","last_undegraded":"2024-04-26T22:03:36.746379+0000","last_fullsized":"2024-04-26T22:03:36.746379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2392,"num_write_kb":17555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'2202","reported_seq":2232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.733322+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T22:03:35.733322+0000","last_peered":"2024-04-26T22:03:35.733322+0000","last_clean":"2024-04-26T22:03:35.733322+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T22:03:35.733322+0000","last_undegraded":"2024-04-26T22:03:35.733322+0000","last_fullsized":"2024-04-26T22:03:35.733322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:43.584233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":59602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'492","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031237+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T22:03:43.031237+0000","last_peered":"2024-04-26T22:03:43.031237+0000","last_clean":"2024-04-26T22:03:43.031237+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T22:03:43.031237+0000","last_undegraded":"2024-04-26T22:03:43.031237+0000","last_fullsized":"2024-04-26T22:03:43.031237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'937","reported_seq":975,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748385+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T22:03:36.748385+0000","last_peered":"2024-04-26T22:03:36.748385+0000","last_clean":"2024-04-26T22:03:36.748385+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T22:03:36.748385+0000","last_undegraded":"2024-04-26T22:03:36.748385+0000","last_fullsized":"2024-04-26T22:03:36.748385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:01:09.729938+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T22:01:09.729938+0000","last_peered":"2024-04-26T22:01:09.729938+0000","last_clean":"2024-04-26T22:01:09.729938+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T22:01:09.729938+0000","last_undegraded":"2024-04-26T22:01:09.729938+0000","last_fullsized":"2024-04-26T22:01:09.729938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2218","reported_seq":2248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186238+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T22:03:35.186238+0000","last_peered":"2024-04-26T22:03:35.186238+0000","last_clean":"2024-04-26T22:03:35.186238+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T22:03:35.186238+0000","last_undegraded":"2024-04-26T22:03:35.186238+0000","last_fullsized":"2024-04-26T22:03:35.186238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1718,"num_write_kb":49388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'483","reported_seq":518,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051569+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T22:03:43.051569+0000","last_peered":"2024-04-26T22:03:43.051569+0000","last_clean":"2024-04-26T22:03:43.051569+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T22:03:43.051569+0000","last_undegraded":"2024-04-26T22:03:43.051569+0000","last_fullsized":"2024-04-26T22:03:43.051569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'1337","reported_seq":1374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:14.287687+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T22:03:14.287687+0000","last_peered":"2024-04-26T22:03:14.287687+0000","last_clean":"2024-04-26T22:03:14.287687+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T22:03:14.287687+0000","last_undegraded":"2024-04-26T22:03:14.287687+0000","last_fullsized":"2024-04-26T22:03:14.287687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":12939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'2226","reported_seq":2256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082628+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T22:03:35.082628+0000","last_peered":"2024-04-26T22:03:35.082628+0000","last_clean":"2024-04-26T22:03:35.082628+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T22:03:35.082628+0000","last_undegraded":"2024-04-26T22:03:35.082628+0000","last_fullsized":"2024-04-26T22:03:35.082628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":82996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'526","reported_seq":561,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.034559+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T22:03:43.034559+0000","last_peered":"2024-04-26T22:03:43.034559+0000","last_clean":"2024-04-26T22:03:43.034559+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T22:03:43.034559+0000","last_undegraded":"2024-04-26T22:03:43.034559+0000","last_fullsized":"2024-04-26T22:03:43.034559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2771","reported_seq":2808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.725372+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T22:03:36.725372+0000","last_peered":"2024-04-26T22:03:36.725372+0000","last_clean":"2024-04-26T22:03:36.725372+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T22:03:36.725372+0000","last_undegraded":"2024-04-26T22:03:36.725372+0000","last_fullsized":"2024-04-26T22:03:36.725372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2771,"log_dups_size":0,"ondisk_log_size":2771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971590,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2774,"num_write_kb":25944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1964","reported_seq":1993,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:34.990272+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T22:03:34.990272+0000","last_peered":"2024-04-26T22:03:34.990272+0000","last_clean":"2024-04-26T22:03:34.990272+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T22:03:34.990272+0000","last_undegraded":"2024-04-26T22:03:34.990272+0000","last_fullsized":"2024-04-26T22:03:34.990272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:03.484896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'495","reported_seq":530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049581+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T22:03:43.049581+0000","last_peered":"2024-04-26T22:03:43.049581+0000","last_clean":"2024-04-26T22:03:43.049581+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T22:03:43.049581+0000","last_undegraded":"2024-04-26T22:03:43.049581+0000","last_fullsized":"2024-04-26T22:03:43.049581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'1459","reported_seq":1496,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:00:39.735974+0000","last_change":"2024-04-26T21:37:16.418849+0000","last_active":"2024-04-26T22:00:39.735974+0000","last_peered":"2024-04-26T22:00:39.735974+0000","last_clean":"2024-04-26T22:00:39.735974+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T22:00:39.735974+0000","last_undegraded":"2024-04-26T22:00:39.735974+0000","last_fullsized":"2024-04-26T22:00:39.735974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1459,"log_dups_size":0,"ondisk_log_size":1459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1458,"num_write_kb":12981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'2194","reported_seq":2224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194184+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T22:03:35.194184+0000","last_peered":"2024-04-26T22:03:35.194184+0000","last_clean":"2024-04-26T22:03:35.194184+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T22:03:35.194184+0000","last_undegraded":"2024-04-26T22:03:35.194184+0000","last_fullsized":"2024-04-26T22:03:35.194184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":50061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'500","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044208+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T22:03:43.044208+0000","last_peered":"2024-04-26T22:03:43.044208+0000","last_clean":"2024-04-26T22:03:43.044208+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T22:03:43.044208+0000","last_undegraded":"2024-04-26T22:03:43.044208+0000","last_fullsized":"2024-04-26T22:03:43.044208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1056","reported_seq":1093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744374+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T22:03:37.744374+0000","last_peered":"2024-04-26T22:03:37.744374+0000","last_clean":"2024-04-26T22:03:37.744374+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T22:03:37.744374+0000","last_undegraded":"2024-04-26T22:03:37.744374+0000","last_fullsized":"2024-04-26T22:03:37.744374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1056,"log_dups_size":0,"ondisk_log_size":1056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":8718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2324","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.179489+0000","last_change":"2024-04-26T21:37:58.755793+0000","last_active":"2024-04-26T22:03:35.179489+0000","last_peered":"2024-04-26T22:03:35.179489+0000","last_clean":"2024-04-26T22:03:35.179489+0000","last_became_active":"2024-04-26T21:37:58.754532+0000","last_became_peered":"2024-04-26T21:37:58.754532+0000","last_unstale":"2024-04-26T22:03:35.179489+0000","last_undegraded":"2024-04-26T22:03:35.179489+0000","last_fullsized":"2024-04-26T22:03:35.179489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:33.156609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":34587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'539","reported_seq":574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043597+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T22:03:43.043597+0000","last_peered":"2024-04-26T22:03:43.043597+0000","last_clean":"2024-04-26T22:03:43.043597+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T22:03:43.043597+0000","last_undegraded":"2024-04-26T22:03:43.043597+0000","last_fullsized":"2024-04-26T22:03:43.043597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'941","reported_seq":978,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.735703+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T22:03:36.735703+0000","last_peered":"2024-04-26T22:03:36.735703+0000","last_clean":"2024-04-26T22:03:36.735703+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T22:03:36.735703+0000","last_undegraded":"2024-04-26T22:03:36.735703+0000","last_fullsized":"2024-04-26T22:03:36.735703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":8676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'1956","reported_seq":1984,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.235647+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T22:03:35.235647+0000","last_peered":"2024-04-26T22:03:35.235647+0000","last_clean":"2024-04-26T22:03:35.235647+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T22:03:35.235647+0000","last_undegraded":"2024-04-26T22:03:35.235647+0000","last_fullsized":"2024-04-26T22:03:35.235647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1956,"log_dups_size":0,"ondisk_log_size":1956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:58.968489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1477,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'502","reported_seq":537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031635+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T22:03:43.031635+0000","last_peered":"2024-04-26T22:03:43.031635+0000","last_clean":"2024-04-26T22:03:43.031635+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T22:03:43.031635+0000","last_undegraded":"2024-04-26T22:03:43.031635+0000","last_fullsized":"2024-04-26T22:03:43.031635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'16","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748578+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T22:03:36.748578+0000","last_peered":"2024-04-26T22:03:36.748578+0000","last_clean":"2024-04-26T22:03:36.748578+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T22:03:36.748578+0000","last_undegraded":"2024-04-26T22:03:36.748578+0000","last_fullsized":"2024-04-26T22:03:36.748578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2142","reported_seq":2170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227910+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T22:03:35.227910+0000","last_peered":"2024-04-26T22:03:35.227910+0000","last_clean":"2024-04-26T22:03:35.227910+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T22:03:35.227910+0000","last_undegraded":"2024-04-26T22:03:35.227910+0000","last_fullsized":"2024-04-26T22:03:35.227910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1648,"num_write_kb":35594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'514","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046487+0000","last_change":"2024-04-26T21:37:58.752144+0000","last_active":"2024-04-26T22:03:43.046487+0000","last_peered":"2024-04-26T22:03:43.046487+0000","last_clean":"2024-04-26T22:03:43.046487+0000","last_became_active":"2024-04-26T21:37:58.751458+0000","last_became_peered":"2024-04-26T21:37:58.751458+0000","last_unstale":"2024-04-26T22:03:43.046487+0000","last_undegraded":"2024-04-26T22:03:43.046487+0000","last_fullsized":"2024-04-26T22:03:43.046487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744268+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T22:03:37.744268+0000","last_peered":"2024-04-26T22:03:37.744268+0000","last_clean":"2024-04-26T22:03:37.744268+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T22:03:37.744268+0000","last_undegraded":"2024-04-26T22:03:37.744268+0000","last_fullsized":"2024-04-26T22:03:37.744268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'2060","reported_seq":2089,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.191326+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T22:03:35.191326+0000","last_peered":"2024-04-26T22:03:35.191326+0000","last_clean":"2024-04-26T22:03:35.191326+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T22:03:35.191326+0000","last_undegraded":"2024-04-26T22:03:35.191326+0000","last_fullsized":"2024-04-26T22:03:35.191326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1564,"num_write_kb":74671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'496","reported_seq":531,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047065+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T22:03:43.047065+0000","last_peered":"2024-04-26T22:03:43.047065+0000","last_clean":"2024-04-26T22:03:43.047065+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T22:03:43.047065+0000","last_undegraded":"2024-04-26T22:03:43.047065+0000","last_fullsized":"2024-04-26T22:03:43.047065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'1736","reported_seq":1773,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:00.173209+0000","last_change":"2024-04-26T21:37:16.434513+0000","last_active":"2024-04-26T22:03:00.173209+0000","last_peered":"2024-04-26T22:03:00.173209+0000","last_clean":"2024-04-26T22:03:00.173209+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T22:03:00.173209+0000","last_undegraded":"2024-04-26T22:03:00.173209+0000","last_fullsized":"2024-04-26T22:03:00.173209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1736,"log_dups_size":0,"ondisk_log_size":1736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1738,"num_write_kb":13055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'1982","reported_seq":2010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.219591+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T22:03:35.219591+0000","last_peered":"2024-04-26T22:03:35.219591+0000","last_clean":"2024-04-26T22:03:35.219591+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T22:03:35.219591+0000","last_undegraded":"2024-04-26T22:03:35.219591+0000","last_fullsized":"2024-04-26T22:03:35.219591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1494,"num_write_kb":56826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'493","reported_seq":527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050223+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T22:03:43.050223+0000","last_peered":"2024-04-26T22:03:43.050223+0000","last_clean":"2024-04-26T22:03:43.050223+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T22:03:43.050223+0000","last_undegraded":"2024-04-26T22:03:43.050223+0000","last_fullsized":"2024-04-26T22:03:43.050223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'2893","reported_seq":2930,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:29.293347+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T22:03:29.293347+0000","last_peered":"2024-04-26T22:03:29.293347+0000","last_clean":"2024-04-26T22:03:29.293347+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T22:03:29.293347+0000","last_undegraded":"2024-04-26T22:03:29.293347+0000","last_fullsized":"2024-04-26T22:03:29.293347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2889,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'2295","reported_seq":2324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.243563+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T22:03:35.243563+0000","last_peered":"2024-04-26T22:03:35.243563+0000","last_clean":"2024-04-26T22:03:35.243563+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T22:03:35.243563+0000","last_undegraded":"2024-04-26T22:03:35.243563+0000","last_fullsized":"2024-04-26T22:03:35.243563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":114189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'491","reported_seq":526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047946+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T22:03:43.047946+0000","last_peered":"2024-04-26T22:03:43.047946+0000","last_clean":"2024-04-26T22:03:43.047946+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T22:03:43.047946+0000","last_undegraded":"2024-04-26T22:03:43.047946+0000","last_fullsized":"2024-04-26T22:03:43.047946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3654","reported_seq":3690,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:39.737799+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T22:03:39.737799+0000","last_peered":"2024-04-26T22:03:39.737799+0000","last_clean":"2024-04-26T22:03:39.737799+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T22:03:39.737799+0000","last_undegraded":"2024-04-26T22:03:39.737799+0000","last_fullsized":"2024-04-26T22:03:39.737799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3659,"num_write_kb":22929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'2192","reported_seq":2221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186824+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T22:03:35.186824+0000","last_peered":"2024-04-26T22:03:35.186824+0000","last_clean":"2024-04-26T22:03:35.186824+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T22:03:35.186824+0000","last_undegraded":"2024-04-26T22:03:35.186824+0000","last_fullsized":"2024-04-26T22:03:35.186824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2192,"log_dups_size":0,"ondisk_log_size":2192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":143042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'491","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.017358+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T22:03:43.017358+0000","last_peered":"2024-04-26T22:03:43.017358+0000","last_clean":"2024-04-26T22:03:43.017358+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T22:03:43.017358+0000","last_undegraded":"2024-04-26T22:03:43.017358+0000","last_fullsized":"2024-04-26T22:03:43.017358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2006","reported_seq":2042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.737621+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T22:03:35.737621+0000","last_peered":"2024-04-26T22:03:35.737621+0000","last_clean":"2024-04-26T22:03:35.737621+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T22:03:35.737621+0000","last_undegraded":"2024-04-26T22:03:35.737621+0000","last_fullsized":"2024-04-26T22:03:35.737621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":21501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'2154","reported_seq":2183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.152690+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T22:03:35.152690+0000","last_peered":"2024-04-26T22:03:35.152690+0000","last_clean":"2024-04-26T22:03:35.152690+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T22:03:35.152690+0000","last_undegraded":"2024-04-26T22:03:35.152690+0000","last_fullsized":"2024-04-26T22:03:35.152690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1666,"num_write_kb":39964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'495","reported_seq":515,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046220+0000","last_change":"2024-04-26T21:37:58.753596+0000","last_active":"2024-04-26T22:03:43.046220+0000","last_peered":"2024-04-26T22:03:43.046220+0000","last_clean":"2024-04-26T22:03:43.046220+0000","last_became_active":"2024-04-26T21:37:58.752756+0000","last_became_peered":"2024-04-26T21:37:58.752756+0000","last_unstale":"2024-04-26T22:03:43.046220+0000","last_undegraded":"2024-04-26T22:03:43.046220+0000","last_fullsized":"2024-04-26T22:03:43.046220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'566","reported_seq":602,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.749120+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T22:03:36.749120+0000","last_peered":"2024-04-26T22:03:36.749120+0000","last_clean":"2024-04-26T22:03:36.749120+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T22:03:36.749120+0000","last_undegraded":"2024-04-26T22:03:36.749120+0000","last_fullsized":"2024-04-26T22:03:36.749120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'2246","reported_seq":2275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.171910+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T22:03:35.171910+0000","last_peered":"2024-04-26T22:03:35.171910+0000","last_clean":"2024-04-26T22:03:35.171910+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T22:03:35.171910+0000","last_undegraded":"2024-04-26T22:03:35.171910+0000","last_fullsized":"2024-04-26T22:03:35.171910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1740,"num_write_kb":51745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'2287","reported_seq":2318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.733263+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T22:03:35.733263+0000","last_peered":"2024-04-26T22:03:35.733263+0000","last_clean":"2024-04-26T22:03:35.733263+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T22:03:35.733263+0000","last_undegraded":"2024-04-26T22:03:35.733263+0000","last_fullsized":"2024-04-26T22:03:35.733263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1846,"num_write_kb":61262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'494","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.028441+0000","last_change":"2024-04-26T21:37:17.435754+0000","last_active":"2024-04-26T22:03:43.028441+0000","last_peered":"2024-04-26T22:03:43.028441+0000","last_clean":"2024-04-26T22:03:43.028441+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T22:03:43.028441+0000","last_undegraded":"2024-04-26T22:03:43.028441+0000","last_fullsized":"2024-04-26T22:03:43.028441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2601","reported_seq":2637,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.751315+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T22:03:36.751315+0000","last_peered":"2024-04-26T22:03:36.751315+0000","last_clean":"2024-04-26T22:03:36.751315+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T22:03:36.751315+0000","last_undegraded":"2024-04-26T22:03:36.751315+0000","last_fullsized":"2024-04-26T22:03:36.751315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2601,"num_write_kb":21771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'2012","reported_seq":2042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.213549+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T22:03:35.213549+0000","last_peered":"2024-04-26T22:03:35.213549+0000","last_clean":"2024-04-26T22:03:35.213549+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T22:03:35.213549+0000","last_undegraded":"2024-04-26T22:03:35.213549+0000","last_fullsized":"2024-04-26T22:03:35.213549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1553,"num_write_kb":109022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'573","reported_seq":607,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036233+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T22:03:43.036233+0000","last_peered":"2024-04-26T22:03:43.036233+0000","last_clean":"2024-04-26T22:03:43.036233+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T22:03:43.036233+0000","last_undegraded":"2024-04-26T22:03:43.036233+0000","last_fullsized":"2024-04-26T22:03:43.036233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'453","reported_seq":489,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.747058+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T22:03:37.747058+0000","last_peered":"2024-04-26T22:03:37.747058+0000","last_clean":"2024-04-26T22:03:37.747058+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T22:03:37.747058+0000","last_undegraded":"2024-04-26T22:03:37.747058+0000","last_fullsized":"2024-04-26T22:03:37.747058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3504","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750936+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T22:03:37.750936+0000","last_peered":"2024-04-26T22:03:37.750936+0000","last_clean":"2024-04-26T22:03:37.750936+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T22:03:37.750936+0000","last_undegraded":"2024-04-26T22:03:37.750936+0000","last_fullsized":"2024-04-26T22:03:37.750936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3514,"num_write_kb":30405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'488","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047178+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T22:03:43.047178+0000","last_peered":"2024-04-26T22:03:43.047178+0000","last_clean":"2024-04-26T22:03:43.047178+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T22:03:43.047178+0000","last_undegraded":"2024-04-26T22:03:43.047178+0000","last_fullsized":"2024-04-26T22:03:43.047178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'2142","reported_seq":2177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.121545+0000","last_change":"2024-04-26T21:37:59.072851+0000","last_active":"2024-04-26T22:03:35.121545+0000","last_peered":"2024-04-26T22:03:35.121545+0000","last_clean":"2024-04-26T22:03:35.121545+0000","last_became_active":"2024-04-26T21:37:59.071221+0000","last_became_peered":"2024-04-26T21:37:59.071221+0000","last_unstale":"2024-04-26T22:03:35.121545+0000","last_undegraded":"2024-04-26T22:03:35.121545+0000","last_fullsized":"2024-04-26T22:03:35.121545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1199","reported_seq":1235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.748058+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T22:03:37.748058+0000","last_peered":"2024-04-26T22:03:37.748058+0000","last_clean":"2024-04-26T22:03:37.748058+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T22:03:37.748058+0000","last_undegraded":"2024-04-26T22:03:37.748058+0000","last_fullsized":"2024-04-26T22:03:37.748058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'501","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038699+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T22:03:43.038699+0000","last_peered":"2024-04-26T22:03:43.038699+0000","last_clean":"2024-04-26T22:03:43.038699+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T22:03:43.038699+0000","last_undegraded":"2024-04-26T22:03:43.038699+0000","last_fullsized":"2024-04-26T22:03:43.038699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'1931","reported_seq":1959,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.228754+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T22:03:35.228754+0000","last_peered":"2024-04-26T22:03:35.228754+0000","last_clean":"2024-04-26T22:03:35.228754+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T22:03:35.228754+0000","last_undegraded":"2024-04-26T22:03:35.228754+0000","last_fullsized":"2024-04-26T22:03:35.228754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1423,"num_write_kb":55204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'524","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.042836+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T22:03:43.042836+0000","last_peered":"2024-04-26T22:03:43.042836+0000","last_clean":"2024-04-26T22:03:43.042836+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T22:03:43.042836+0000","last_undegraded":"2024-04-26T22:03:43.042836+0000","last_fullsized":"2024-04-26T22:03:43.042836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'551","reported_seq":587,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.023075+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T22:03:43.023075+0000","last_peered":"2024-04-26T22:03:43.023075+0000","last_clean":"2024-04-26T22:03:43.023075+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T22:03:43.023075+0000","last_undegraded":"2024-04-26T22:03:43.023075+0000","last_fullsized":"2024-04-26T22:03:43.023075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:06.431151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'499","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029683+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T22:03:43.029683+0000","last_peered":"2024-04-26T22:03:43.029683+0000","last_clean":"2024-04-26T22:03:43.029683+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T22:03:43.029683+0000","last_undegraded":"2024-04-26T22:03:43.029683+0000","last_fullsized":"2024-04-26T22:03:43.029683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'508","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029954+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T22:03:43.029954+0000","last_peered":"2024-04-26T22:03:43.029954+0000","last_clean":"2024-04-26T22:03:43.029954+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T22:03:43.029954+0000","last_undegraded":"2024-04-26T22:03:43.029954+0000","last_fullsized":"2024-04-26T22:03:43.029954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'476","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045803+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T22:03:43.045803+0000","last_peered":"2024-04-26T22:03:43.045803+0000","last_clean":"2024-04-26T22:03:43.045803+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T22:03:43.045803+0000","last_undegraded":"2024-04-26T22:03:43.045803+0000","last_fullsized":"2024-04-26T22:03:43.045803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'489","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026150+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T22:03:43.026150+0000","last_peered":"2024-04-26T22:03:43.026150+0000","last_clean":"2024-04-26T22:03:43.026150+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T22:03:43.026150+0000","last_undegraded":"2024-04-26T22:03:43.026150+0000","last_fullsized":"2024-04-26T22:03:43.026150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'522","reported_seq":558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050293+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T22:03:43.050293+0000","last_peered":"2024-04-26T22:03:43.050293+0000","last_clean":"2024-04-26T22:03:43.050293+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T22:03:43.050293+0000","last_undegraded":"2024-04-26T22:03:43.050293+0000","last_fullsized":"2024-04-26T22:03:43.050293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'475","reported_seq":511,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047218+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T22:03:43.047218+0000","last_peered":"2024-04-26T22:03:43.047218+0000","last_clean":"2024-04-26T22:03:43.047218+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T22:03:43.047218+0000","last_undegraded":"2024-04-26T22:03:43.047218+0000","last_fullsized":"2024-04-26T22:03:43.047218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'513","reported_seq":534,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031332+0000","last_change":"2024-04-26T21:37:58.751645+0000","last_active":"2024-04-26T22:03:43.031332+0000","last_peered":"2024-04-26T22:03:43.031332+0000","last_clean":"2024-04-26T22:03:43.031332+0000","last_became_active":"2024-04-26T21:37:58.749833+0000","last_became_peered":"2024-04-26T21:37:58.749833+0000","last_unstale":"2024-04-26T22:03:43.031332+0000","last_undegraded":"2024-04-26T22:03:43.031332+0000","last_fullsized":"2024-04-26T22:03:43.031332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:15.821911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"26'482","reported_seq":517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045694+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T22:03:43.045694+0000","last_peered":"2024-04-26T22:03:43.045694+0000","last_clean":"2024-04-26T22:03:43.045694+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T22:03:43.045694+0000","last_undegraded":"2024-04-26T22:03:43.045694+0000","last_fullsized":"2024-04-26T22:03:43.045694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'530","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047951+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T22:03:43.047951+0000","last_peered":"2024-04-26T22:03:43.047951+0000","last_clean":"2024-04-26T22:03:43.047951+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T22:03:43.047951+0000","last_undegraded":"2024-04-26T22:03:43.047951+0000","last_fullsized":"2024-04-26T22:03:43.047951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'488","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047329+0000","last_change":"2024-04-26T21:37:17.439778+0000","last_active":"2024-04-26T22:03:43.047329+0000","last_peered":"2024-04-26T22:03:43.047329+0000","last_clean":"2024-04-26T22:03:43.047329+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T22:03:43.047329+0000","last_undegraded":"2024-04-26T22:03:43.047329+0000","last_fullsized":"2024-04-26T22:03:43.047329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'512","reported_seq":547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044243+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T22:03:43.044243+0000","last_peered":"2024-04-26T22:03:43.044243+0000","last_clean":"2024-04-26T22:03:43.044243+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T22:03:43.044243+0000","last_undegraded":"2024-04-26T22:03:43.044243+0000","last_fullsized":"2024-04-26T22:03:43.044243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'505","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049561+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T22:03:43.049561+0000","last_peered":"2024-04-26T22:03:43.049561+0000","last_clean":"2024-04-26T22:03:43.049561+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T22:03:43.049561+0000","last_undegraded":"2024-04-26T22:03:43.049561+0000","last_fullsized":"2024-04-26T22:03:43.049561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'459","reported_seq":494,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039316+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T22:03:43.039316+0000","last_peered":"2024-04-26T22:03:43.039316+0000","last_clean":"2024-04-26T22:03:43.039316+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T22:03:43.039316+0000","last_undegraded":"2024-04-26T22:03:43.039316+0000","last_fullsized":"2024-04-26T22:03:43.039316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:34.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'525","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050851+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T22:03:43.050851+0000","last_peered":"2024-04-26T22:03:43.050851+0000","last_clean":"2024-04-26T22:03:43.050851+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T22:03:43.050851+0000","last_undegraded":"2024-04-26T22:03:43.050851+0000","last_fullsized":"2024-04-26T22:03:43.050851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'520","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037528+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T22:03:43.037528+0000","last_peered":"2024-04-26T22:03:43.037528+0000","last_clean":"2024-04-26T22:03:43.037528+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T22:03:43.037528+0000","last_undegraded":"2024-04-26T22:03:43.037528+0000","last_fullsized":"2024-04-26T22:03:43.037528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'505","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.022688+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T22:03:43.022688+0000","last_peered":"2024-04-26T22:03:43.022688+0000","last_clean":"2024-04-26T22:03:43.022688+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T22:03:43.022688+0000","last_undegraded":"2024-04-26T22:03:43.022688+0000","last_fullsized":"2024-04-26T22:03:43.022688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'510","reported_seq":545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035772+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T22:03:43.035772+0000","last_peered":"2024-04-26T22:03:43.035772+0000","last_clean":"2024-04-26T22:03:43.035772+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T22:03:43.035772+0000","last_undegraded":"2024-04-26T22:03:43.035772+0000","last_fullsized":"2024-04-26T22:03:43.035772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:38.335510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'476","reported_seq":510,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035648+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T22:03:43.035648+0000","last_peered":"2024-04-26T22:03:43.035648+0000","last_clean":"2024-04-26T22:03:43.035648+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T22:03:43.035648+0000","last_undegraded":"2024-04-26T22:03:43.035648+0000","last_fullsized":"2024-04-26T22:03:43.035648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'494","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037947+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T22:03:43.037947+0000","last_peered":"2024-04-26T22:03:43.037947+0000","last_clean":"2024-04-26T22:03:43.037947+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T22:03:43.037947+0000","last_undegraded":"2024-04-26T22:03:43.037947+0000","last_fullsized":"2024-04-26T22:03:43.037947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'475","reported_seq":509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032023+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T22:03:43.032023+0000","last_peered":"2024-04-26T22:03:43.032023+0000","last_clean":"2024-04-26T22:03:43.032023+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T22:03:43.032023+0000","last_undegraded":"2024-04-26T22:03:43.032023+0000","last_fullsized":"2024-04-26T22:03:43.032023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049937+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T22:03:43.049937+0000","last_peered":"2024-04-26T22:03:43.049937+0000","last_clean":"2024-04-26T22:03:43.049937+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T22:03:43.049937+0000","last_undegraded":"2024-04-26T22:03:43.049937+0000","last_fullsized":"2024-04-26T22:03:43.049937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'506","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051623+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T22:03:43.051623+0000","last_peered":"2024-04-26T22:03:43.051623+0000","last_clean":"2024-04-26T22:03:43.051623+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T22:03:43.051623+0000","last_undegraded":"2024-04-26T22:03:43.051623+0000","last_fullsized":"2024-04-26T22:03:43.051623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'470","reported_seq":490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.024943+0000","last_change":"2024-04-26T21:37:59.071288+0000","last_active":"2024-04-26T22:03:43.024943+0000","last_peered":"2024-04-26T22:03:43.024943+0000","last_clean":"2024-04-26T22:03:43.024943+0000","last_became_active":"2024-04-26T21:37:59.070372+0000","last_became_peered":"2024-04-26T21:37:59.070372+0000","last_unstale":"2024-04-26T22:03:43.024943+0000","last_undegraded":"2024-04-26T22:03:43.024943+0000","last_fullsized":"2024-04-26T22:03:43.024943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037366+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T22:03:43.037366+0000","last_peered":"2024-04-26T22:03:43.037366+0000","last_clean":"2024-04-26T22:03:43.037366+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T22:03:43.037366+0000","last_undegraded":"2024-04-26T22:03:43.037366+0000","last_fullsized":"2024-04-26T22:03:43.037366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'482","reported_seq":516,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038091+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T22:03:43.038091+0000","last_peered":"2024-04-26T22:03:43.038091+0000","last_clean":"2024-04-26T22:03:43.038091+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T22:03:43.038091+0000","last_undegraded":"2024-04-26T22:03:43.038091+0000","last_fullsized":"2024-04-26T22:03:43.038091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'509","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044575+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T22:03:43.044575+0000","last_peered":"2024-04-26T22:03:43.044575+0000","last_clean":"2024-04-26T22:03:43.044575+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T22:03:43.044575+0000","last_undegraded":"2024-04-26T22:03:43.044575+0000","last_fullsized":"2024-04-26T22:03:43.044575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'509","reported_seq":546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036324+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T22:03:43.036324+0000","last_peered":"2024-04-26T22:03:43.036324+0000","last_clean":"2024-04-26T22:03:43.036324+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T22:03:43.036324+0000","last_undegraded":"2024-04-26T22:03:43.036324+0000","last_fullsized":"2024-04-26T22:03:43.036324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'488","reported_seq":524,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026593+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T22:03:43.026593+0000","last_peered":"2024-04-26T22:03:43.026593+0000","last_clean":"2024-04-26T22:03:43.026593+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T22:03:43.026593+0000","last_undegraded":"2024-04-26T22:03:43.026593+0000","last_fullsized":"2024-04-26T22:03:43.026593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'487","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035868+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T22:03:43.035868+0000","last_peered":"2024-04-26T22:03:43.035868+0000","last_clean":"2024-04-26T22:03:43.035868+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T22:03:43.035868+0000","last_undegraded":"2024-04-26T22:03:43.035868+0000","last_fullsized":"2024-04-26T22:03:43.035868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'477","reported_seq":513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050222+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T22:03:43.050222+0000","last_peered":"2024-04-26T22:03:43.050222+0000","last_clean":"2024-04-26T22:03:43.050222+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T22:03:43.050222+0000","last_undegraded":"2024-04-26T22:03:43.050222+0000","last_fullsized":"2024-04-26T22:03:43.050222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52831,"num_write_kb":2071742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68463,"ondisk_log_size":68463,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31956,"ondisk_log_size":31956,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":240165372,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":58367,"num_write_kb":440918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":480387072,"data_stored":480330744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55417,"ondisk_log_size":55417,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575171,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279712,"kb_used_data":50008,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94092128,"statfs":{"total":96636764160,"available":96350339072,"internally_reserved":0,"allocated":51208192,"data_stored":51036951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325156,"kb_used_data":63580,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94046684,"statfs":{"total":96636764160,"available":96303804416,"internally_reserved":0,"allocated":65105920,"data_stored":64933386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575172,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":69908,"kb_used_omap":1,"kb_used_meta":233726,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":71585792,"data_stored":71417611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239335877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575172,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309348,"kb_used_data":65820,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94062492,"statfs":{"total":96636764160,"available":96319991808,"internally_reserved":0,"allocated":67399680,"data_stored":67223343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249362886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575171,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397252,"kb_used_data":73212,"kb_used_omap":1,"kb_used_meta":324030,"kb_avail":93974588,"statfs":{"total":96636764160,"available":96229978112,"internally_reserved":0,"allocated":74969088,"data_stored":74797270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":331807175},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575173,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211836,"kb_used_data":36340,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94160004,"statfs":{"total":96636764160,"available":96419844096,"internally_reserved":0,"allocated":37212160,"data_stored":37047862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575173,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":427684,"kb_used_data":75868,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93944156,"statfs":{"total":96636764160,"available":96198815744,"internally_reserved":0,"allocated":77688832,"data_stored":77515786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257640,"kb_used_data":37728,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94114200,"statfs":{"total":96636764160,"available":96372940800,"internally_reserved":0,"allocated":38633472,"data_stored":38454095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225180102},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77410304,"data_stored":77401433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36933632,"data_stored":36933509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74690560,"data_stored":74682917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":67121152,"data_stored":67108990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64827392,"data_stored":64819033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:03:50.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:03:51.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.212+0000 7f092d200640 1 Processor -- start 2024-04-26T22:03:51.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.213+0000 7f092d200640 1 -- start start 2024-04-26T22:03:51.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f092d200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f09280b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:51.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f092d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0928148d10 0x7f0928142770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:51.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f092d200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09280bb260 con 0x7f0928142310 2024-04-26T22:03:51.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f092d200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09280b6270 con 0x7f0928148d10 2024-04-26T22:03:51.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f092d200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f09280b6550 con 0x7f09280bae80 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f091fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0928142310 0x7f0928148600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48474/0 (socket says 172.21.15.5:48474) 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f091fe00640 1 -- 172.21.15.5:0/3119143776 learned_addr learned my addr 172.21.15.5:0/3119143776 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f0927e00640 1 --2- 172.21.15.5:0/3119143776 >> v2:172.21.15.5:3300/0 conn(0x7f0928148d10 0x7f0928142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.214+0000 7f0927400640 1 --2- 172.21.15.5:0/3119143776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f09280b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.215+0000 7f0926a00640 1 -- 172.21.15.5:0/3119143776 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837518203 0 0) 0x7f09280bb260 con 0x7f0928142310 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.215+0000 7f0926a00640 1 -- 172.21.15.5:0/3119143776 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f090c003520 con 0x7f0928142310 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.215+0000 7f0927e00640 1 -- 172.21.15.5:0/3119143776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 msgr2=0x7f09280b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.215+0000 7f0927e00640 1 --2- 172.21.15.5:0/3119143776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f09280b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.215+0000 7f0927e00640 1 -- 172.21.15.5:0/3119143776 >> v1:172.21.15.5:6789/0 conn(0x7f0928142310 legacy=0x7f0928148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.215+0000 7f0927e00640 1 -- 172.21.15.5:0/3119143776 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09280b6830 con 0x7f0928148d10 2024-04-26T22:03:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.215+0000 7f0927400640 1 --2- 172.21.15.5:0/3119143776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f09280b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.216+0000 7f0927e00640 1 --2- 172.21.15.5:0/3119143776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f0928142770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d90 tx=0x7f092002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8add503f640e9b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.216+0000 7f0926a00640 1 -- 172.21.15.5:0/3119143776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920031600 con 0x7f0928148d10 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.216+0000 7f0926a00640 1 -- 172.21.15.5:0/3119143776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09200317a0 con 0x7f0928148d10 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.216+0000 7f0926a00640 1 -- 172.21.15.5:0/3119143776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920031b70 con 0x7f0928148d10 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 -- 172.21.15.5:0/3119143776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 msgr2=0x7f0928142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 --2- 172.21.15.5:0/3119143776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f0928142770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d90 tx=0x7f092002a5d0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 -- 172.21.15.5:0/3119143776 shutdown_connections 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 --2- 172.21.15.5:0/3119143776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f0928142770 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 --2- 172.21.15.5:0/3119143776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f09280b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 -- 172.21.15.5:0/3119143776 >> 172.21.15.5:0/3119143776 conn(0x7f09280684b0 msgr2=0x7f09280688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:51.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 -- 172.21.15.5:0/3119143776 shutdown_connections 2024-04-26T22:03:51.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.217+0000 7f092d200640 1 -- 172.21.15.5:0/3119143776 wait complete. 2024-04-26T22:03:51.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.219+0000 7f092d200640 1 Processor -- start 2024-04-26T22:03:51.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.219+0000 7f092d200640 1 -- start start 2024-04-26T22:03:51.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f092d200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f0928145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:51.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f092d200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0928142310 0x7f0928144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:51.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f092d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f092813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:51.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f092d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0928152e10 con 0x7f0928148d10 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f092d200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09280ba3a0 con 0x7f0928142310 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f092d200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0928152f90 con 0x7f09280bae80 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f0927e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f092813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f0927e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f092813afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34218/0 (socket says 172.21.15.5:34218) 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f0927e00640 1 -- 172.21.15.5:0/3848870462 learned_addr learned my addr 172.21.15.5:0/3848870462 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.220+0000 7f0927400640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f0928145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f091fe00640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0928142310 0x7f0928144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f0927e00640 1 -- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 msgr2=0x7f0928145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f0927e00640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f0928145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f0927e00640 1 -- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0928142310 msgr2=0x7f0928144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f0927e00640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0928142310 0x7f0928144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f0927e00640 1 -- 172.21.15.5:0/3848870462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0928144780 con 0x7f0928148d10 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f0927400640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f0928145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:51.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f0927e00640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f092813afe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f092002abc0 tx=0x7f0920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:51.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f091f400640 1 -- 172.21.15.5:0/3848870462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092003f070 con 0x7f0928148d10 2024-04-26T22:03:51.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f091f400640 1 -- 172.21.15.5:0/3848870462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0920030b60 con 0x7f0928148d10 2024-04-26T22:03:51.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f091f400640 1 -- 172.21.15.5:0/3848870462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920009450 con 0x7f0928148d10 2024-04-26T22:03:51.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0928144a00 con 0x7f0928148d10 2024-04-26T22:03:51.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.221+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092813d760 con 0x7f0928148d10 2024-04-26T22:03:51.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.223+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0928075db0 con 0x7f0928148d10 2024-04-26T22:03:51.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.224+0000 7f091f400640 1 -- 172.21.15.5:0/3848870462 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f092003b410 con 0x7f0928148d10 2024-04-26T22:03:51.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.225+0000 7f091f400640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f090406c920 0x7f090406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:51.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.225+0000 7f091f400640 1 -- 172.21.15.5:0/3848870462 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f09200ad410 con 0x7f0928148d10 2024-04-26T22:03:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.225+0000 7f0927400640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f090406c920 0x7f090406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.227+0000 7f0927400640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f090406c920 0x7f090406ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0918006fd0 tx=0x7f0918008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:51.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.230+0000 7f091f400640 1 -- 172.21.15.5:0/3848870462 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0928144780 con 0x7f0928148d10 2024-04-26T22:03:51.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.438+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0928152ad0 con 0x7f0928148d10 2024-04-26T22:03:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.440+0000 7f091f400640 1 -- 172.21.15.5:0/3848870462 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18776 (secure 0 0 0) 0x7f092007b4d0 con 0x7f0928148d10 2024-04-26T22:03:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:03:51.441 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:58.718657+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f090406c920 msgr2=0x7f090406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f090406c920 0x7f090406ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0918006fd0 tx=0x7f0918008040 comp rx=0 tx=0).stop 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 msgr2=0x7f092813afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f092813afe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f092002abc0 tx=0x7f0920004a40 comp rx=0 tx=0).stop 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 shutdown_connections 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f090406c920 0x7f090406ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928148d10 0x7f092813afe0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0928142310 0x7f0928144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 --2- 172.21.15.5:0/3848870462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09280bae80 0x7f0928145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 >> 172.21.15.5:0/3848870462 conn(0x7f09280684b0 msgr2=0x7f0928075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 shutdown_connections 2024-04-26T22:03:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:51.443+0000 7f092d200640 1 -- 172.21.15.5:0/3848870462 wait complete. 2024-04-26T22:03:52.464 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T22:03:52.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.680+0000 7fe7aee00640 1 Processor -- start 2024-04-26T22:03:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.680+0000 7fe7aee00640 1 -- start start 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7aee00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7a80be9a0 0x7fe7a814c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7aee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7a814c590 0x7fe7a81422a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7aee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a80b7d20 con 0x7fe7a81427e0 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7aee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a80bed80 con 0x7fe7a814c590 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7aee00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a814c9f0 con 0x7fe7a80be9a0 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7a7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7a814c590 0x7fe7a81422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7ace00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe7a81427e0 0x7fe7a80b8940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48484/0 (socket says 172.21.15.5:48484) 2024-04-26T22:03:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.682+0000 7fe7ace00640 1 -- 172.21.15.5:0/2973938304 learned_addr learned my addr 172.21.15.5:0/2973938304 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.683+0000 7fe7a7e00640 1 --2- 172.21.15.5:0/2973938304 >> v2:172.21.15.112:3300/0 conn(0x7fe7a80be9a0 0x7fe7a814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.683+0000 7fe7a7400640 1 -- 172.21.15.5:0/2973938304 >> v2:172.21.15.112:3300/0 conn(0x7fe7a80be9a0 msgr2=0x7fe7a814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.683+0000 7fe7a7400640 1 --2- 172.21.15.5:0/2973938304 >> v2:172.21.15.112:3300/0 conn(0x7fe7a80be9a0 0x7fe7a814c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.683+0000 7fe7a7400640 1 -- 172.21.15.5:0/2973938304 >> v1:172.21.15.5:6789/0 conn(0x7fe7a81427e0 legacy=0x7fe7a80b8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.683+0000 7fe7a7400640 1 -- 172.21.15.5:0/2973938304 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a80b5fe0 con 0x7fe7a814c590 2024-04-26T22:03:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.683+0000 7fe7a6a00640 1 -- 172.21.15.5:0/2973938304 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112077856 0 0) 0x7fe7a80b7d20 con 0x7fe7a81427e0 2024-04-26T22:03:52.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.684+0000 7fe7a7400640 1 --2- 172.21.15.5:0/2973938304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a814c590 0x7fe7a81422a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80b99c0 tx=0x7fe79402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2cb5be19ee6bc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:52.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.684+0000 7fe7a6a00640 1 -- 172.21.15.5:0/2973938304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794037070 con 0x7fe7a814c590 2024-04-26T22:03:52.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.684+0000 7fe7a6a00640 1 -- 172.21.15.5:0/2973938304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe794032440 con 0x7fe7a814c590 2024-04-26T22:03:52.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.684+0000 7fe7a6a00640 1 -- 172.21.15.5:0/2973938304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79402ae60 con 0x7fe7a814c590 2024-04-26T22:03:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 -- 172.21.15.5:0/2973938304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a814c590 msgr2=0x7fe7a81422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 --2- 172.21.15.5:0/2973938304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a814c590 0x7fe7a81422a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80b99c0 tx=0x7fe79402a110 comp rx=0 tx=0).stop 2024-04-26T22:03:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 -- 172.21.15.5:0/2973938304 shutdown_connections 2024-04-26T22:03:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 --2- 172.21.15.5:0/2973938304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a814c590 0x7fe7a81422a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 --2- 172.21.15.5:0/2973938304 >> v2:172.21.15.112:3300/0 conn(0x7fe7a80be9a0 0x7fe7a814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 -- 172.21.15.5:0/2973938304 >> 172.21.15.5:0/2973938304 conn(0x7fe7a8068720 msgr2=0x7fe7a80bdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 -- 172.21.15.5:0/2973938304 shutdown_connections 2024-04-26T22:03:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.685+0000 7fe7aee00640 1 -- 172.21.15.5:0/2973938304 wait complete. 2024-04-26T22:03:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.687+0000 7fe7aee00640 1 Processor -- start 2024-04-26T22:03:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.687+0000 7fe7aee00640 1 -- start start 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7aee00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7a80be9a0 0x7fe7a81444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7aee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a81427e0 0x7fe7a8145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7aee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a814c590 0x7fe7a81d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7aee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a8142c30 con 0x7fe7a81427e0 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7aee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a80b7f90 con 0x7fe7a814c590 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7aee00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a8142db0 con 0x7fe7a80be9a0 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7a7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a81427e0 0x7fe7a8145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7a7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a81427e0 0x7fe7a8145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34224/0 (socket says 172.21.15.5:34224) 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.688+0000 7fe7a7400640 1 -- 172.21.15.5:0/247507598 learned_addr learned my addr 172.21.15.5:0/247507598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7a7e00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7a80be9a0 0x7fe7a81444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7ace00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a814c590 0x7fe7a81d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7a7400640 1 -- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7a80be9a0 msgr2=0x7fe7a81444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7a7400640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7a80be9a0 0x7fe7a81444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7a7400640 1 -- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a814c590 msgr2=0x7fe7a81d3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7a7400640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a814c590 0x7fe7a81d3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7a7400640 1 -- 172.21.15.5:0/247507598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a8144a00 con 0x7fe7a81427e0 2024-04-26T22:03:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7ace00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a814c590 0x7fe7a81d3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.689+0000 7fe7a7400640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a81427e0 0x7fe7a8145720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c00 tx=0x7fe7940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:52.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.690+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794037050 con 0x7fe7a81427e0 2024-04-26T22:03:52.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.690+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe794038040 con 0x7fe7a81427e0 2024-04-26T22:03:52.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.690+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794004470 con 0x7fe7a81427e0 2024-04-26T22:03:52.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.690+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a8144cd0 con 0x7fe7a81427e0 2024-04-26T22:03:52.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.690+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a81434b0 con 0x7fe7a81427e0 2024-04-26T22:03:52.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.691+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7a8075db0 con 0x7fe7a81427e0 2024-04-26T22:03:52.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.692+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe794030900 con 0x7fe7a81427e0 2024-04-26T22:03:52.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.693+0000 7fe79fe00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe78806c8f0 0x7fe78806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.693+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe7940ad420 con 0x7fe7a81427e0 2024-04-26T22:03:52.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.694+0000 7fe79fe00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7fe788076310 0x7fe7880787b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.694+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 --> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe794008eb0 con 0x7fe788076310 2024-04-26T22:03:52.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.694+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7940ad7d0 con 0x7fe7a81427e0 2024-04-26T22:03:52.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.694+0000 7fe7a7e00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe78806c8f0 0x7fe78806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.694+0000 7fe7ace00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7fe788076310 0x7fe7880787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.695+0000 7fe7ace00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7fe788076310 0x7fe7880787b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:52.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.695+0000 7fe7a7e00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe78806c8f0 0x7fe78806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe798006fd0 tx=0x7fe798008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.695+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== osd.0 v2:172.21.15.5:6800/2132096310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe794008eb0 con 0x7fe788076310 2024-04-26T22:03:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.710+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 --> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7a80b79d0 con 0x7fe788076310 2024-04-26T22:03:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.711+0000 7fe79fe00640 1 -- 172.21.15.5:0/247507598 <== osd.0 v2:172.21.15.5:6800/2132096310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7a80b79d0 con 0x7fe788076310 2024-04-26T22:03:52.711 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:52.711 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.711+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7fe788076310 msgr2=0x7fe7880787b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.711+0000 7fe7aee00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:6800/2132096310,v1:172.21.15.5:6802/2132096310] conn(0x7fe788076310 0x7fe7880787b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe78806c8f0 msgr2=0x7fe78806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe78806c8f0 0x7fe78806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe798006fd0 tx=0x7fe798008040 comp rx=0 tx=0).stop 2024-04-26T22:03:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a81427e0 msgr2=0x7fe7a8145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 --2- 172.21.15.5:0/247507598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7a81427e0 0x7fe7a8145720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c00 tx=0x7fe7940046c0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7ace00640 1 -- 172.21.15.5:0/247507598 reap_dead start 2024-04-26T22:03:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 shutdown_connections 2024-04-26T22:03:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 >> 172.21.15.5:0/247507598 conn(0x7fe7a8068720 msgr2=0x7fe7a8075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 shutdown_connections 2024-04-26T22:03:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.712+0000 7fe7aee00640 1 -- 172.21.15.5:0/247507598 wait complete. 2024-04-26T22:03:52.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T22:03:52.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.912+0000 7ff474a00640 1 Processor -- start 2024-04-26T22:03:52.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.912+0000 7ff474a00640 1 -- start start 2024-04-26T22:03:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.913+0000 7ff474a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff470142b70 0x7ff4700b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.913+0000 7ff474a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 0x7ff470152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.913+0000 7ff474a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4700b5e00 con 0x7ff4700b68f0 2024-04-26T22:03:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.913+0000 7ff474a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff47014bfe0 con 0x7ff470142b70 2024-04-26T22:03:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.913+0000 7ff474a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4700b7e80 con 0x7ff47014bb70 2024-04-26T22:03:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.914+0000 7ff46de00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4700b68f0 0x7ff470142460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48496/0 (socket says 172.21.15.5:48496) 2024-04-26T22:03:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.914+0000 7ff46de00640 1 -- 172.21.15.5:0/2848515522 learned_addr learned my addr 172.21.15.5:0/2848515522 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.914+0000 7ff46d400640 1 --2- 172.21.15.5:0/2848515522 >> v2:172.21.15.112:3300/0 conn(0x7ff470142b70 0x7ff4700b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.914+0000 7ff46e800640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 0x7ff470152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.914+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085140744 0 0) 0x7ff4700b5e00 con 0x7ff4700b68f0 2024-04-26T22:03:52.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.914+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff454003520 con 0x7ff4700b68f0 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.914+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 679812280 0 0) 0x7ff454003520 con 0x7ff4700b68f0 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 msgr2=0x7ff470152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 0x7ff470152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 >> v2:172.21.15.112:3300/0 conn(0x7ff470142b70 msgr2=0x7ff4700b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 --2- 172.21.15.5:0/2848515522 >> v2:172.21.15.112:3300/0 conn(0x7ff470142b70 0x7ff4700b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4700b4bf0 con 0x7ff4700b68f0 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7ff460001670 con 0x7ff4700b68f0 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 >> v1:172.21.15.5:6789/0 conn(0x7ff4700b68f0 legacy=0x7ff470142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 0x7ff4540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff454003f30 0x7ff454004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff4540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff47014bfe0 con 0x7ff454004d40 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4700b7e80 con 0x7ff454003f30 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff45400ba10 con 0x7ff47014bb70 2024-04-26T22:03:52.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46e800640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff4540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46de00640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 0x7ff4540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.915+0000 7ff46d400640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff454003f30 0x7ff454004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.916+0000 7ff46e800640 1 -- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 msgr2=0x7ff4540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:52.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.916+0000 7ff46e800640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff47014bb70 0x7ff4540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.916+0000 7ff46e800640 1 -- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff454003f30 msgr2=0x7ff454004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:52.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.916+0000 7ff46e800640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff454003f30 0x7ff454004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.916+0000 7ff46e800640 1 -- 172.21.15.5:0/2848515522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff454003520 con 0x7ff454004d40 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.917+0000 7ff46e800640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff4540051c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff46800e170 tx=0x7ff454005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1773c34184614f24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.917+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468034020 con 0x7ff454004d40 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.917+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4680305f0 con 0x7ff454004d40 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.917+0000 7ff46ca00640 1 -- 172.21.15.5:0/2848515522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468009c10 con 0x7ff454004d40 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.917+0000 7ff474a00640 1 -- 172.21.15.5:0/2848515522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 msgr2=0x7ff4540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.917+0000 7ff474a00640 1 --2- 172.21.15.5:0/2848515522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff4540051c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff46800e170 tx=0x7ff454005830 comp rx=0 tx=0).stop 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.917+0000 7ff46e800640 1 -- 172.21.15.5:0/2848515522 reap_dead start 2024-04-26T22:03:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.918+0000 7ff474a00640 1 -- 172.21.15.5:0/2848515522 shutdown_connections 2024-04-26T22:03:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.918+0000 7ff474a00640 1 -- 172.21.15.5:0/2848515522 >> 172.21.15.5:0/2848515522 conn(0x7ff470068480 msgr2=0x7ff470068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.918+0000 7ff474a00640 1 -- 172.21.15.5:0/2848515522 shutdown_connections 2024-04-26T22:03:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.918+0000 7ff474a00640 1 -- 172.21.15.5:0/2848515522 wait complete. 2024-04-26T22:03:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.920+0000 7ff474a00640 1 Processor -- start 2024-04-26T22:03:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.920+0000 7ff474a00640 1 -- start start 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff474a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff47014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff474a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff470143170 0x7ff4701416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff474a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff470144810 0x7ff4701e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff474a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4700bb580 con 0x7ff454004d40 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff474a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4700bb330 con 0x7ff470143170 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff474a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4700b52e0 con 0x7ff470144810 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff47014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff47014ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34238/0 (socket says 172.21.15.5:34238) 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 -- 172.21.15.5:0/3149724394 learned_addr learned my addr 172.21.15.5:0/3149724394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:52.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 -- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff470144810 msgr2=0x7ff4701e0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46e800640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff470144810 0x7ff4701e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff470144810 0x7ff4701e0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 -- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff470143170 msgr2=0x7ff4701416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff470143170 0x7ff4701416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.921+0000 7ff46de00640 1 -- 172.21.15.5:0/3149724394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff470145a20 con 0x7ff454004d40 2024-04-26T22:03:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.922+0000 7ff46de00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff47014ac30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff46000e870 tx=0x7ff46000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.922+0000 7ff466000640 1 -- 172.21.15.5:0/3149724394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46000c8d0 con 0x7ff454004d40 2024-04-26T22:03:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.922+0000 7ff466000640 1 -- 172.21.15.5:0/3149724394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460018070 con 0x7ff454004d40 2024-04-26T22:03:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.922+0000 7ff466000640 1 -- 172.21.15.5:0/3149724394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46000ccb0 con 0x7ff454004d40 2024-04-26T22:03:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.922+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff470145fa0 con 0x7ff454004d40 2024-04-26T22:03:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.922+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff470145040 con 0x7ff454004d40 2024-04-26T22:03:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.924+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff470075db0 con 0x7ff454004d40 2024-04-26T22:03:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.924+0000 7ff466000640 1 -- 172.21.15.5:0/3149724394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff46001d460 con 0x7ff454004d40 2024-04-26T22:03:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.926+0000 7ff466000640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff45006c8f0 0x7ff45006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.926+0000 7ff466000640 1 -- 172.21.15.5:0/3149724394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff46008bee0 con 0x7ff454004d40 2024-04-26T22:03:52.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.926+0000 7ff46d400640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff45006c8f0 0x7ff45006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:52.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.928+0000 7ff46d400640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff45006c8f0 0x7ff45006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff470143590 tx=0x7ff45c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:52.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:52.931+0000 7ff466000640 1 -- 172.21.15.5:0/3149724394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff460059f00 con 0x7ff454004d40 2024-04-26T22:03:53.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.156+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff47014b590 con 0x7ff45006c8f0 2024-04-26T22:03:53.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.157+0000 7ff466000640 1 -- 172.21.15.5:0/3149724394 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff47014b590 con 0x7ff45006c8f0 2024-04-26T22:03:53.157 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T22:03:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff45006c8f0 msgr2=0x7ff45006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff45006c8f0 0x7ff45006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff470143590 tx=0x7ff45c008040 comp rx=0 tx=0).stop 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 msgr2=0x7ff47014ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff47014ac30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff46000e870 tx=0x7ff46000ed30 comp rx=0 tx=0).stop 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 shutdown_connections 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff470144810 0x7ff4701e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff470143170 0x7ff4701416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff45006c8f0 0x7ff45006edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 --2- 172.21.15.5:0/3149724394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff454004d40 0x7ff47014ac30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 >> 172.21.15.5:0/3149724394 conn(0x7ff470068480 msgr2=0x7ff470142230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 shutdown_connections 2024-04-26T22:03:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.160+0000 7ff474a00640 1 -- 172.21.15.5:0/3149724394 wait complete. 2024-04-26T22:03:53.178 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T22:03:53.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.373+0000 7f6d1ee00640 1 Processor -- start 2024-04-26T22:03:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.373+0000 7f6d1ee00640 1 -- start start 2024-04-26T22:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.374+0000 7f6d1ee00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d1806da40 0x7f6d180b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.374+0000 7f6d1ee00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 0x7f6d180b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.374+0000 7f6d1ee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1806de20 con 0x7f6d18143510 2024-04-26T22:03:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.374+0000 7f6d1ee00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6d180b4d80 con 0x7f6d1806da40 2024-04-26T22:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.374+0000 7f6d1ee00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6d180b5060 con 0x7f6d18073c10 2024-04-26T22:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.375+0000 7f6d1e400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6d18143510 0x7f6d1809b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48512/0 (socket says 172.21.15.5:48512) 2024-04-26T22:03:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.375+0000 7f6d1e400640 1 -- 172.21.15.5:0/2789517201 learned_addr learned my addr 172.21.15.5:0/2789517201 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.375+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2789517201 >> v2:172.21.15.112:3300/0 conn(0x7f6d1806da40 0x7f6d180b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.375+0000 7f6d1d000640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 0x7f6d180b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.375+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327458536 0 0) 0x7f6d1806de20 con 0x7f6d18143510 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.375+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d00003520 con 0x7f6d18143510 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 719563418 0 0) 0x7f6d00003520 con 0x7f6d18143510 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 msgr2=0x7f6d180b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 0x7f6d180b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 >> v2:172.21.15.112:3300/0 conn(0x7f6d1806da40 msgr2=0x7f6d180b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 --2- 172.21.15.5:0/2789517201 >> v2:172.21.15.112:3300/0 conn(0x7f6d1806da40 0x7f6d180b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d180b49a0 con 0x7f6d18143510 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f6d100019f0 con 0x7f6d18143510 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 >> v1:172.21.15.5:6789/0 conn(0x7f6d18143510 legacy=0x7f6d1809b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000039b0 0x7f6d00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d00004800 0x7f6d00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 0x7f6d000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180b4d80 con 0x7f6d000039b0 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180b5060 con 0x7f6d00004800 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0000ba40 con 0x7f6d18073c10 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000039b0 0x7f6d00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.376+0000 7f6d1e400640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 0x7f6d000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.377+0000 7f6d1da00640 1 -- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 msgr2=0x7f6d000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.377+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 0x7f6d000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.377+0000 7f6d1d000640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d00004800 0x7f6d00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.377+0000 7f6d1da00640 1 -- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d00004800 msgr2=0x7f6d00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.377+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d00004800 0x7f6d00004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.377+0000 7f6d1da00640 1 -- 172.21.15.5:0/2789517201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d00003520 con 0x7f6d000039b0 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.377+0000 7f6d1e400640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d18073c10 0x7f6d000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000039b0 0x7f6d00003dd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009ac0 tx=0x7f6d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c02e02571bfef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08036070 con 0x7f6d000039b0 2024-04-26T22:03:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d08031400 con 0x7f6d000039b0 2024-04-26T22:03:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d17e00640 1 -- 172.21.15.5:0/2789517201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08009690 con 0x7f6d000039b0 2024-04-26T22:03:53.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2789517201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000039b0 msgr2=0x7f6d00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d1ee00640 1 --2- 172.21.15.5:0/2789517201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000039b0 0x7f6d00003dd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009ac0 tx=0x7f6d00005830 comp rx=0 tx=0).stop 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d1e400640 1 -- 172.21.15.5:0/2789517201 reap_dead start 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2789517201 shutdown_connections 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.378+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2789517201 >> 172.21.15.5:0/2789517201 conn(0x7f6d1806c6f0 msgr2=0x7f6d1806cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.379+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2789517201 shutdown_connections 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.379+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2789517201 wait complete. 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.380+0000 7f6d1ee00640 1 Processor -- start 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.380+0000 7f6d1ee00640 1 -- start start 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1ee00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d000039b0 0x7f6d180afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1ee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d181d1310 0x7f6d180b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1813c410 0x7f6d1813c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180b6100 con 0x7f6d1813c410 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1ee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180b5f80 con 0x7f6d181d1310 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1ee00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6d180b6280 con 0x7f6d000039b0 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1813c410 0x7f6d1813c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1813c410 0x7f6d1813c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34266/0 (socket says 172.21.15.5:34266) 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.381+0000 7f6d1e400640 1 -- 172.21.15.5:0/2212030908 learned_addr learned my addr 172.21.15.5:0/2212030908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d000039b0 0x7f6d180afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1d000640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d181d1310 0x7f6d180b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1e400640 1 -- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d000039b0 msgr2=0x7f6d180afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1e400640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d000039b0 0x7f6d180afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1e400640 1 -- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d181d1310 msgr2=0x7f6d180b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1e400640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d181d1310 0x7f6d180b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1e400640 1 -- 172.21.15.5:0/2212030908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d181d1ab0 con 0x7f6d1813c410 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1e400640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1813c410 0x7f6d1813c870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d100013d0 tx=0x7f6d1000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10004d60 con 0x7f6d1813c410 2024-04-26T22:03:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1000bb20 con 0x7f6d1813c410 2024-04-26T22:03:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10007110 con 0x7f6d1813c410 2024-04-26T22:03:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.382+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d181471d0 con 0x7f6d1813c410 2024-04-26T22:03:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.383+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d181d0ba0 con 0x7f6d1813c410 2024-04-26T22:03:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.384+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d18075db0 con 0x7f6d1813c410 2024-04-26T22:03:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.385+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d1001b020 con 0x7f6d1813c410 2024-04-26T22:03:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.386+0000 7f6d15600640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6cfc06c8f0 0x7f6cfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.386+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6d1008c120 con 0x7f6d1813c410 2024-04-26T22:03:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.386+0000 7f6d15600640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f6cfc076310 0x7f6cfc0787b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.386+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 --> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cfc078e80 con 0x7f6cfc076310 2024-04-26T22:03:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.386+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6d10093050 con 0x7f6d1813c410 2024-04-26T22:03:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.387+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6cfc06c8f0 0x7f6cfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.387+0000 7f6d1d000640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f6cfc076310 0x7f6cfc0787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.387+0000 7f6d1d000640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f6cfc076310 0x7f6cfc0787b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.388+0000 7f6d1da00640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6cfc06c8f0 0x7f6cfc06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d08033000 tx=0x7f6d08008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.388+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== osd.1 v2:172.21.15.5:6801/29367179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cfc078e80 con 0x7f6cfc076310 2024-04-26T22:03:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.403+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 --> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6d181d17d0 con 0x7f6cfc076310 2024-04-26T22:03:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.403+0000 7f6d15600640 1 -- 172.21.15.5:0/2212030908 <== osd.1 v2:172.21.15.5:6801/29367179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6d181d17d0 con 0x7f6cfc076310 2024-04-26T22:03:53.403 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:53.403 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:53.403 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.403+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f6cfc076310 msgr2=0x7f6cfc0787b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.403+0000 7f6d1ee00640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:6801/29367179,v1:172.21.15.5:6804/29367179] conn(0x7f6cfc076310 0x7f6cfc0787b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6cfc06c8f0 msgr2=0x7f6cfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f6cfc06c8f0 0x7f6cfc06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d08033000 tx=0x7f6d08008030 comp rx=0 tx=0).stop 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1813c410 msgr2=0x7f6d1813c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 --2- 172.21.15.5:0/2212030908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1813c410 0x7f6d1813c870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d100013d0 tx=0x7f6d1000b4a0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1e400640 1 -- 172.21.15.5:0/2212030908 reap_dead start 2024-04-26T22:03:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 shutdown_connections 2024-04-26T22:03:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 >> 172.21.15.5:0/2212030908 conn(0x7f6d1806c6f0 msgr2=0x7f6d180b8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 shutdown_connections 2024-04-26T22:03:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.404+0000 7f6d1ee00640 1 -- 172.21.15.5:0/2212030908 wait complete. 2024-04-26T22:03:53.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T22:03:53.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.603+0000 7f2c42200640 1 Processor -- start 2024-04-26T22:03:53.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.603+0000 7f2c42200640 1 -- start start 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c42200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c3c0bae80 0x7f2c3c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c42200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c3c142310 0x7f2c3c1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c42200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c3c0bb260 con 0x7f2c3c148600 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c42200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2c3c0b6270 con 0x7f2c3c0bae80 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c42200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2c3c0b6550 con 0x7f2c3c142310 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c40e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c3c0bae80 0x7f2c3c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c41800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2c3c148600 0x7f2c3c148a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48522/0 (socket says 172.21.15.5:48522) 2024-04-26T22:03:53.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c40e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c3c0bae80 0x7f2c3c0b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34270/0 (socket says 172.21.15.5:34270) 2024-04-26T22:03:53.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c41800640 1 -- 172.21.15.5:0/864556501 learned_addr learned my addr 172.21.15.5:0/864556501 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:53.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c3be00640 1 --2- 172.21.15.5:0/864556501 >> v2:172.21.15.112:3300/0 conn(0x7f2c3c142310 0x7f2c3c1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c40e00640 1 -- 172.21.15.5:0/864556501 >> v2:172.21.15.112:3300/0 conn(0x7f2c3c142310 msgr2=0x7f2c3c1427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:53.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c40e00640 1 --2- 172.21.15.5:0/864556501 >> v2:172.21.15.112:3300/0 conn(0x7f2c3c142310 0x7f2c3c1427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c40e00640 1 -- 172.21.15.5:0/864556501 >> v1:172.21.15.5:6789/0 conn(0x7f2c3c148600 legacy=0x7f2c3c148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.605+0000 7f2c40e00640 1 -- 172.21.15.5:0/864556501 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c0b6830 con 0x7f2c3c0bae80 2024-04-26T22:03:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.606+0000 7f2c40e00640 1 --2- 172.21.15.5:0/864556501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c0bae80 0x7f2c3c0b57d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0bb880 tx=0x7f2c2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faa4b2fabb4628b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c3b400640 1 -- 172.21.15.5:0/864556501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c037070 con 0x7f2c3c0bae80 2024-04-26T22:03:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c3b400640 1 -- 172.21.15.5:0/864556501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2c032440 con 0x7f2c3c0bae80 2024-04-26T22:03:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c3b400640 1 -- 172.21.15.5:0/864556501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c02ae60 con 0x7f2c3c0bae80 2024-04-26T22:03:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c42200640 1 -- 172.21.15.5:0/864556501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c0bae80 msgr2=0x7f2c3c0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c42200640 1 --2- 172.21.15.5:0/864556501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c0bae80 0x7f2c3c0b57d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0bb880 tx=0x7f2c2c02a110 comp rx=0 tx=0).stop 2024-04-26T22:03:53.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c42200640 1 -- 172.21.15.5:0/864556501 shutdown_connections 2024-04-26T22:03:53.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c42200640 1 --2- 172.21.15.5:0/864556501 >> v2:172.21.15.112:3300/0 conn(0x7f2c3c142310 0x7f2c3c1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c42200640 1 --2- 172.21.15.5:0/864556501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c0bae80 0x7f2c3c0b57d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c42200640 1 -- 172.21.15.5:0/864556501 >> 172.21.15.5:0/864556501 conn(0x7f2c3c0684b0 msgr2=0x7f2c3c0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:53.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.607+0000 7f2c42200640 1 -- 172.21.15.5:0/864556501 shutdown_connections 2024-04-26T22:03:53.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.608+0000 7f2c42200640 1 -- 172.21.15.5:0/864556501 wait complete. 2024-04-26T22:03:53.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.609+0000 7f2c42200640 1 Processor -- start 2024-04-26T22:03:53.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.609+0000 7f2c42200640 1 -- start start 2024-04-26T22:03:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c42200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0bae80 0x7f2c3c1e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c42200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c142310 0x7f2c3c142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c42200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c148600 0x7f2c3c14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c42200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c152e10 con 0x7f2c3c148600 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c42200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c0ba3a0 con 0x7f2c3c142310 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c42200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c152f90 con 0x7f2c3c0bae80 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c41800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c148600 0x7f2c3c14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c41800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c148600 0x7f2c3c14a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34278/0 (socket says 172.21.15.5:34278) 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c41800640 1 -- 172.21.15.5:0/4161527711 learned_addr learned my addr 172.21.15.5:0/4161527711 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.610+0000 7f2c40e00640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0bae80 0x7f2c3c1e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c3be00640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c142310 0x7f2c3c142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c41800640 1 -- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0bae80 msgr2=0x7f2c3c1e1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c41800640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0bae80 0x7f2c3c1e1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c41800640 1 -- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c142310 msgr2=0x7f2c3c142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c41800640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c142310 0x7f2c3c142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c41800640 1 -- 172.21.15.5:0/4161527711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c145930 con 0x7f2c3c148600 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c41800640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c148600 0x7f2c3c14a8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400cab0 tx=0x7f2c3400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c38c00640 1 -- 172.21.15.5:0/4161527711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34017070 con 0x7f2c3c148600 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c38c00640 1 -- 172.21.15.5:0/4161527711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3400ac30 con 0x7f2c3c148600 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c38c00640 1 -- 172.21.15.5:0/4161527711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34012400 con 0x7f2c3c148600 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c1e1030 con 0x7f2c3c148600 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.611+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c1e15f0 con 0x7f2c3c148600 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.612+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3c075db0 con 0x7f2c3c148600 2024-04-26T22:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.613+0000 7f2c38c00640 1 -- 172.21.15.5:0/4161527711 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c3401a070 con 0x7f2c3c148600 2024-04-26T22:03:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.614+0000 7f2c38c00640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2c1806c8f0 0x7f2c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.614+0000 7f2c38c00640 1 -- 172.21.15.5:0/4161527711 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2c3408bb90 con 0x7f2c3c148600 2024-04-26T22:03:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.615+0000 7f2c40e00640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2c1806c8f0 0x7f2c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.616+0000 7f2c40e00640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2c1806c8f0 0x7f2c1806edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c034000 tx=0x7f2c2c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.619+0000 7f2c38c00640 1 -- 172.21.15.5:0/4161527711 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2c34059560 con 0x7f2c3c148600 2024-04-26T22:03:53.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.843+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2c3c074290 con 0x7f2c1806c8f0 2024-04-26T22:03:53.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.844+0000 7f2c38c00640 1 -- 172.21.15.5:0/4161527711 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c3c074290 con 0x7f2c1806c8f0 2024-04-26T22:03:53.844 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.847+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2c1806c8f0 msgr2=0x7f2c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.847+0000 7f2c42200640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2c1806c8f0 0x7f2c1806edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c034000 tx=0x7f2c2c02e000 comp rx=0 tx=0).stop 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c148600 msgr2=0x7f2c3c14a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c148600 0x7f2c3c14a8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400cab0 tx=0x7f2c3400cf70 comp rx=0 tx=0).stop 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 shutdown_connections 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2c1806c8f0 0x7f2c1806edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c3c148600 0x7f2c3c14a8b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c3c142310 0x7f2c3c142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 --2- 172.21.15.5:0/4161527711 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2c3c0bae80 0x7f2c3c1e1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 >> 172.21.15.5:0/4161527711 conn(0x7f2c3c0684b0 msgr2=0x7f2c3c146400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 shutdown_connections 2024-04-26T22:03:53.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:53.848+0000 7f2c42200640 1 -- 172.21.15.5:0/4161527711 wait complete. 2024-04-26T22:03:53.866 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T22:03:53.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.080+0000 7f158ec00640 1 Processor -- start 2024-04-26T22:03:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.081+0000 7f158ec00640 1 -- start start 2024-04-26T22:03:54.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.082+0000 7f158ec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 0x7f1588071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.082+0000 7f158ec00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15880b6550 0x7f1588142340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.082+0000 7f158ec00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15880b83e0 con 0x7f15880b1ae0 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.082+0000 7f158ec00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f15880b60c0 con 0x7f15880b6550 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.082+0000 7f158ec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f15880b5a70 con 0x7f15880b8000 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.082+0000 7f158ce00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15880b1ae0 0x7f1588072d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48534/0 (socket says 172.21.15.5:48534) 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.083+0000 7f158ce00640 1 -- 172.21.15.5:0/3640183730 learned_addr learned my addr 172.21.15.5:0/3640183730 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.083+0000 7f158e200640 1 --2- 172.21.15.5:0/3640183730 >> v2:172.21.15.112:3300/0 conn(0x7f15880b6550 0x7f1588142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.083+0000 7f158d800640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 0x7f1588071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.083+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270119496 0 0) 0x7f15880b83e0 con 0x7f15880b1ae0 2024-04-26T22:03:54.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.083+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f156c003520 con 0x7f15880b1ae0 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.083+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3166217983 0 0) 0x7f156c003520 con 0x7f15880b1ae0 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 msgr2=0x7f1588071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 0x7f1588071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 >> v2:172.21.15.112:3300/0 conn(0x7f15880b6550 msgr2=0x7f1588142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 --2- 172.21.15.5:0/3640183730 >> v2:172.21.15.112:3300/0 conn(0x7f15880b6550 0x7f1588142340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15880b5d50 con 0x7f15880b1ae0 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f1574001670 con 0x7f15880b1ae0 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 >> v1:172.21.15.5:6789/0 conn(0x7f15880b1ae0 legacy=0x7f1588072d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156c0039b0 0x7f156c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 0x7f156c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c004d40 0x7f156c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15880b60c0 con 0x7f156c0039b0 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15880b5a70 con 0x7f156c004d40 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f156c00b9c0 con 0x7f15880b8000 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158e200640 1 --2- 172.21.15.5:0/3640183730 >> v2:172.21.15.112:3300/0 conn(0x7f15880b6550 0x7f1588142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158d800640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156c0039b0 0x7f156c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158ce00640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 0x7f156c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158d800640 1 -- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 msgr2=0x7f156c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158d800640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15880b8000 0x7f156c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158d800640 1 -- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c004d40 msgr2=0x7f156c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158d800640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c004d40 0x7f156c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.084+0000 7f158d800640 1 -- 172.21.15.5:0/3640183730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c003520 con 0x7f156c0039b0 2024-04-26T22:03:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.085+0000 7f158d800640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156c0039b0 0x7f156c003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1578009fc0 tx=0x7f156c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a5da5598ae96cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.086+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578009c10 con 0x7f156c0039b0 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.086+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1578036070 con 0x7f156c0039b0 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.086+0000 7f1587e00640 1 -- 172.21.15.5:0/3640183730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578031880 con 0x7f156c0039b0 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.086+0000 7f158ec00640 1 -- 172.21.15.5:0/3640183730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156c0039b0 msgr2=0x7f156c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.086+0000 7f158ec00640 1 --2- 172.21.15.5:0/3640183730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f156c0039b0 0x7f156c003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1578009fc0 tx=0x7f156c005830 comp rx=0 tx=0).stop 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.086+0000 7f158e200640 1 -- 172.21.15.5:0/3640183730 reap_dead start 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.087+0000 7f158ec00640 1 -- 172.21.15.5:0/3640183730 shutdown_connections 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.087+0000 7f158ec00640 1 -- 172.21.15.5:0/3640183730 >> 172.21.15.5:0/3640183730 conn(0x7f15880bb1b0 msgr2=0x7f15880b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.087+0000 7f158ec00640 1 -- 172.21.15.5:0/3640183730 shutdown_connections 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.087+0000 7f158ec00640 1 -- 172.21.15.5:0/3640183730 wait complete. 2024-04-26T22:03:54.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.088+0000 7f158ec00640 1 Processor -- start 2024-04-26T22:03:54.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.088+0000 7f158ec00640 1 -- start start 2024-04-26T22:03:54.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c0039b0 0x7f1588141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ec00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15880afe70 0x7f15881e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15881e14d0 0x7f158813abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ec00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1588071510 con 0x7f15880afe70 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1588071390 con 0x7f156c0039b0 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1588071690 con 0x7f15881e14d0 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15880afe70 0x7f15881e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.089+0000 7f158ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15880afe70 0x7f15881e0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34284/0 (socket says 172.21.15.5:34284) 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158ce00640 1 -- 172.21.15.5:0/190060842 learned_addr learned my addr 172.21.15.5:0/190060842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158d800640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c0039b0 0x7f1588141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158e200640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15881e14d0 0x7f158813abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158ce00640 1 -- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15881e14d0 msgr2=0x7f158813abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158ce00640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f15881e14d0 0x7f158813abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158ce00640 1 -- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c0039b0 msgr2=0x7f1588141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158ce00640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f156c0039b0 0x7f1588141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158ce00640 1 -- 172.21.15.5:0/190060842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15881e1950 con 0x7f15880afe70 2024-04-26T22:03:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f158ce00640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15880afe70 0x7f15881e0f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f157400e8c0 tx=0x7f157400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.090+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157400c8d0 con 0x7f15880afe70 2024-04-26T22:03:54.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.091+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1574018070 con 0x7f15880afe70 2024-04-26T22:03:54.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.091+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15880b1170 con 0x7f15880afe70 2024-04-26T22:03:54.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.091+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157400ccb0 con 0x7f15880afe70 2024-04-26T22:03:54.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.091+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158814ab50 con 0x7f15880afe70 2024-04-26T22:03:54.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.092+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15880b1830 con 0x7f15880afe70 2024-04-26T22:03:54.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.093+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1574026430 con 0x7f15880afe70 2024-04-26T22:03:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.094+0000 7f1585600640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f156806c920 0x7f156806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.094+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f157408c500 con 0x7f15880afe70 2024-04-26T22:03:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.094+0000 7f1585600640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7f1568076330 0x7f15680787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.094+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 --> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1574006ea0 con 0x7f1568076330 2024-04-26T22:03:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.094+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f157408c990 con 0x7f15880afe70 2024-04-26T22:03:54.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.095+0000 7f158e200640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7f1568076330 0x7f15680787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.095+0000 7f158d800640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f156806c920 0x7f156806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.095+0000 7f158e200640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7f1568076330 0x7f15680787d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.096+0000 7f158d800640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f156806c920 0x7f156806ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1578035000 tx=0x7f157802f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.096+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== osd.2 v2:172.21.15.5:6816/1477821475 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1574006ea0 con 0x7f1568076330 2024-04-26T22:03:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.112+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 --> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1588075db0 con 0x7f1568076330 2024-04-26T22:03:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.112+0000 7f1585600640 1 -- 172.21.15.5:0/190060842 <== osd.2 v2:172.21.15.5:6816/1477821475 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1588075db0 con 0x7f1568076330 2024-04-26T22:03:54.112 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:54.112 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:54.112 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7f1568076330 msgr2=0x7f15680787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:6816/1477821475,v1:172.21.15.5:6817/1477821475] conn(0x7f1568076330 0x7f15680787d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f156806c920 msgr2=0x7f156806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f156806c920 0x7f156806ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1578035000 tx=0x7f157802f000 comp rx=0 tx=0).stop 2024-04-26T22:03:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15880afe70 msgr2=0x7f15881e0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 --2- 172.21.15.5:0/190060842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15880afe70 0x7f15881e0f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f157400e8c0 tx=0x7f157400ed80 comp rx=0 tx=0).stop 2024-04-26T22:03:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158e200640 1 -- 172.21.15.5:0/190060842 reap_dead start 2024-04-26T22:03:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 shutdown_connections 2024-04-26T22:03:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 >> 172.21.15.5:0/190060842 conn(0x7f15880bb1b0 msgr2=0x7f158813bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 shutdown_connections 2024-04-26T22:03:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.113+0000 7f158ec00640 1 -- 172.21.15.5:0/190060842 wait complete. 2024-04-26T22:03:54.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T22:03:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.329+0000 7ff782600640 1 Processor -- start 2024-04-26T22:03:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.329+0000 7ff782600640 1 -- start start 2024-04-26T22:03:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.330+0000 7ff782600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.330+0000 7ff782600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff77c1425e0 0x7ff77c142a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.330+0000 7ff782600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff77c0bcae0 con 0x7ff77c06f230 2024-04-26T22:03:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.330+0000 7ff782600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff77c0b8230 con 0x7ff77c1425e0 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.330+0000 7ff782600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff77c06df90 con 0x7ff77c0bc700 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff77c1425e0 0x7ff77c142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff77c1425e0 0x7ff77c142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53900/0 (socket says 172.21.15.5:53900) 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77be00640 1 -- 172.21.15.5:0/3164458334 learned_addr learned my addr 172.21.15.5:0/3164458334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77b400640 1 --2- 172.21.15.5:0/3164458334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77be00640 1 -- 172.21.15.5:0/3164458334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 msgr2=0x7ff77c148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77be00640 1 --2- 172.21.15.5:0/3164458334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77be00640 1 -- 172.21.15.5:0/3164458334 >> v1:172.21.15.112:6789/0 conn(0x7ff77c06f230 legacy=0x7ff77c0b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77be00640 1 -- 172.21.15.5:0/3164458334 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c06ea30 con 0x7ff77c1425e0 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.331+0000 7ff77b400640 1 --2- 172.21.15.5:0/3164458334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.332+0000 7ff77be00640 1 --2- 172.21.15.5:0/3164458334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c1425e0 0x7ff77c142a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e50 tx=0x7ff77402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499436029c7c364b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff77a000640 1 -- 172.21.15.5:0/3164458334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774036070 con 0x7ff77c1425e0 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff77a000640 1 -- 172.21.15.5:0/3164458334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff774031600 con 0x7ff77c1425e0 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff77a000640 1 -- 172.21.15.5:0/3164458334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7740319d0 con 0x7ff77c1425e0 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff782600640 1 -- 172.21.15.5:0/3164458334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c1425e0 msgr2=0x7ff77c142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff782600640 1 --2- 172.21.15.5:0/3164458334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c1425e0 0x7ff77c142a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e50 tx=0x7ff77402a6c0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff782600640 1 -- 172.21.15.5:0/3164458334 shutdown_connections 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff782600640 1 --2- 172.21.15.5:0/3164458334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c1425e0 0x7ff77c142a90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff782600640 1 --2- 172.21.15.5:0/3164458334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.333+0000 7ff782600640 1 -- 172.21.15.5:0/3164458334 >> 172.21.15.5:0/3164458334 conn(0x7ff77c0686c0 msgr2=0x7ff77c0bbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.334+0000 7ff782600640 1 -- 172.21.15.5:0/3164458334 shutdown_connections 2024-04-26T22:03:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.334+0000 7ff782600640 1 -- 172.21.15.5:0/3164458334 wait complete. 2024-04-26T22:03:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.335+0000 7ff782600640 1 Processor -- start 2024-04-26T22:03:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.335+0000 7ff782600640 1 -- start start 2024-04-26T22:03:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff782600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff782600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1425e0 0x7ff77c143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff782600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c143c80 0x7ff77c1e1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff782600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c148c90 con 0x7ff77c143c80 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff782600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c06e700 con 0x7ff77c1425e0 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff782600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff77c153090 con 0x7ff77c0bc700 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff77be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c143c80 0x7ff77c1e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff77be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c143c80 0x7ff77c1e1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53912/0 (socket says 172.21.15.5:53912) 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.336+0000 7ff77be00640 1 -- 172.21.15.5:0/1960209703 learned_addr learned my addr 172.21.15.5:0/1960209703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77aa00640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1425e0 0x7ff77c143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77b400640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77be00640 1 -- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 msgr2=0x7ff77c145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77be00640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77be00640 1 -- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1425e0 msgr2=0x7ff77c143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77be00640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1425e0 0x7ff77c143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77be00640 1 -- 172.21.15.5:0/1960209703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c145610 con 0x7ff77c143c80 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.337+0000 7ff77be00640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c143c80 0x7ff77c1e1700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e50 tx=0x7ff774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.338+0000 7ff773400640 1 -- 172.21.15.5:0/1960209703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774036050 con 0x7ff77c143c80 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.338+0000 7ff773400640 1 -- 172.21.15.5:0/1960209703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff774042070 con 0x7ff77c143c80 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.338+0000 7ff773400640 1 -- 172.21.15.5:0/1960209703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774009510 con 0x7ff77c143c80 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.338+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c1434e0 con 0x7ff77c143c80 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.338+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c0b5bf0 con 0x7ff77c143c80 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.339+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77c1473a0 con 0x7ff77c143c80 2024-04-26T22:03:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.340+0000 7ff773400640 1 -- 172.21.15.5:0/1960209703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff774007bd0 con 0x7ff77c143c80 2024-04-26T22:03:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.341+0000 7ff773400640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff75c06c8f0 0x7ff75c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.342+0000 7ff773400640 1 -- 172.21.15.5:0/1960209703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff7740ace80 con 0x7ff77c143c80 2024-04-26T22:03:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.342+0000 7ff77b400640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff75c06c8f0 0x7ff75c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.344+0000 7ff77b400640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff75c06c8f0 0x7ff75c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0b5340 tx=0x7ff76c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.346+0000 7ff773400640 1 -- 172.21.15.5:0/1960209703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff77c1473a0 con 0x7ff77c143c80 2024-04-26T22:03:54.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.552+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff77c075db0 con 0x7ff75c06c8f0 2024-04-26T22:03:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.553+0000 7ff773400640 1 -- 172.21.15.5:0/1960209703 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff77c075db0 con 0x7ff75c06c8f0 2024-04-26T22:03:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T22:03:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.556+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff75c06c8f0 msgr2=0x7ff75c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.556+0000 7ff782600640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff75c06c8f0 0x7ff75c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0b5340 tx=0x7ff76c008040 comp rx=0 tx=0).stop 2024-04-26T22:03:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.556+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c143c80 msgr2=0x7ff77c1e1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.556+0000 7ff782600640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c143c80 0x7ff77c1e1700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e50 tx=0x7ff774004a40 comp rx=0 tx=0).stop 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 shutdown_connections 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff75c06c8f0 0x7ff75c06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff77c143c80 0x7ff77c1e1700 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1425e0 0x7ff77c143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 --2- 172.21.15.5:0/1960209703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff77c0bc700 0x7ff77c145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 >> 172.21.15.5:0/1960209703 conn(0x7ff77c0686c0 msgr2=0x7ff77c1467a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 shutdown_connections 2024-04-26T22:03:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.557+0000 7ff782600640 1 -- 172.21.15.5:0/1960209703 wait complete. 2024-04-26T22:03:54.574 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T22:03:54.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.780+0000 7fb857200640 1 Processor -- start 2024-04-26T22:03:54.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.781+0000 7fb857200640 1 -- start start 2024-04-26T22:03:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.782+0000 7fb857200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 0x7fb8581421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.782+0000 7fb857200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8580b7f10 con 0x7fb85814c270 2024-04-26T22:03:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.782+0000 7fb857200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8580beb20 con 0x7fb8580be740 2024-04-26T22:03:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.782+0000 7fb857200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb8580b5e90 con 0x7fb8580b6c60 2024-04-26T22:03:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.783+0000 7fb856800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb85814c270 0x7fb858152e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45234/0 (socket says 172.21.15.5:45234) 2024-04-26T22:03:54.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.783+0000 7fb856800640 1 -- 172.21.15.5:0/228999078 learned_addr learned my addr 172.21.15.5:0/228999078 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.783+0000 7fb855400640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 0x7fb8581421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.783+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987087151 0 0) 0x7fb8580b7f10 con 0x7fb85814c270 2024-04-26T22:03:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.783+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb83c003520 con 0x7fb85814c270 2024-04-26T22:03:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1633579976 0 0) 0x7fb83c003520 con 0x7fb85814c270 2024-04-26T22:03:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 msgr2=0x7fb8581421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 0x7fb8581421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 >> v1:172.21.15.112:6789/0 conn(0x7fb8580be740 legacy=0x7fb85814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8580b5840 con 0x7fb85814c270 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fb8500019f0 con 0x7fb85814c270 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 >> v1:172.21.15.5:6789/0 conn(0x7fb85814c270 legacy=0x7fb858152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb83c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb83c004800 0x7fb83c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 0x7fb83c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580b5e90 con 0x7fb83c0039e0 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c005520 con 0x7fb83c004800 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb83c00bf00 con 0x7fb8580b6c60 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb855e00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb83c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb856800640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 0x7fb83c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.784+0000 7fb855400640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb83c004800 0x7fb83c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.785+0000 7fb855e00640 1 -- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 msgr2=0x7fb83c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.785+0000 7fb855e00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8580b6c60 0x7fb83c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.785+0000 7fb855e00640 1 -- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb83c004800 msgr2=0x7fb83c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.785+0000 7fb855e00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb83c004800 0x7fb83c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.785+0000 7fb855e00640 1 -- 172.21.15.5:0/228999078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c003520 con 0x7fb83c0039e0 2024-04-26T22:03:54.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.785+0000 7fb855400640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb83c004800 0x7fb83c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.786+0000 7fb855e00640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb83c003e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb848001750 tx=0x7fb83c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb7f1da57f1780b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.786+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848001370 con 0x7fb83c0039e0 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.786+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480052d0 con 0x7fb83c0039e0 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.786+0000 7fb854a00640 1 -- 172.21.15.5:0/228999078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84802abe0 con 0x7fb83c0039e0 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.786+0000 7fb857200640 1 -- 172.21.15.5:0/228999078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 msgr2=0x7fb83c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.787+0000 7fb857200640 1 --2- 172.21.15.5:0/228999078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb83c003e00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb848001750 tx=0x7fb83c005830 comp rx=0 tx=0).stop 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.787+0000 7fb856800640 1 -- 172.21.15.5:0/228999078 reap_dead start 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.787+0000 7fb857200640 1 -- 172.21.15.5:0/228999078 shutdown_connections 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.787+0000 7fb857200640 1 -- 172.21.15.5:0/228999078 >> 172.21.15.5:0/228999078 conn(0x7fb8580686c0 msgr2=0x7fb8580bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.787+0000 7fb857200640 1 -- 172.21.15.5:0/228999078 shutdown_connections 2024-04-26T22:03:54.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.787+0000 7fb857200640 1 -- 172.21.15.5:0/228999078 wait complete. 2024-04-26T22:03:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.788+0000 7fb857200640 1 Processor -- start 2024-04-26T22:03:54.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.789+0000 7fb857200640 1 -- start start 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.789+0000 7fb857200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb858145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.789+0000 7fb857200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8581e19b0 0x7fb8581dd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.789+0000 7fb857200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8580ad590 0x7fb8580b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.789+0000 7fb857200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580b55e0 con 0x7fb83c0039e0 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.789+0000 7fb857200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580b5460 con 0x7fb8580ad590 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.789+0000 7fb857200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb8580ba480 con 0x7fb8581e19b0 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb858145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb858145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53930/0 (socket says 172.21.15.5:53930) 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 -- 172.21.15.5:0/2773875334 learned_addr learned my addr 172.21.15.5:0/2773875334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb856800640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8580ad590 0x7fb8580b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855400640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8581e19b0 0x7fb8581dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 -- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8581e19b0 msgr2=0x7fb8581dd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8581e19b0 0x7fb8581dd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 -- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8580ad590 msgr2=0x7fb8580b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8580ad590 0x7fb8580b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855e00640 1 -- 172.21.15.5:0/2773875334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8581e0f10 con 0x7fb83c0039e0 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb855400640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8581e19b0 0x7fb8581dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.790+0000 7fb856800640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8580ad590 0x7fb8580b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:54.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.791+0000 7fb855e00640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb858145730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb848008fd0 tx=0x7fb848001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.791+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848037040 con 0x7fb83c0039e0 2024-04-26T22:03:54.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.791+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb848005480 con 0x7fb83c0039e0 2024-04-26T22:03:54.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.791+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848007a30 con 0x7fb83c0039e0 2024-04-26T22:03:54.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.791+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8580af030 con 0x7fb83c0039e0 2024-04-26T22:03:54.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.791+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8581e1490 con 0x7fb83c0039e0 2024-04-26T22:03:54.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.792+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb858075db0 con 0x7fb83c0039e0 2024-04-26T22:03:54.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.793+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb848044020 con 0x7fb83c0039e0 2024-04-26T22:03:54.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.794+0000 7fb84e000640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb83806c8f0 0x7fb83806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.794+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb8480abc40 con 0x7fb83c0039e0 2024-04-26T22:03:54.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.795+0000 7fb84e000640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7fb838076310 0x7fb8380787b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:54.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.795+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 --> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb84802b800 con 0x7fb838076310 2024-04-26T22:03:54.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.795+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb8480b02a0 con 0x7fb83c0039e0 2024-04-26T22:03:54.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.795+0000 7fb855400640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb83806c8f0 0x7fb83806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.795+0000 7fb856800640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7fb838076310 0x7fb8380787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:54.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.796+0000 7fb856800640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7fb838076310 0x7fb8380787b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.796+0000 7fb855400640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb83806c8f0 0x7fb83806edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb8580ad350 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:54.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.796+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== osd.3 v2:172.21.15.5:6822/3678222192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb84802b800 con 0x7fb838076310 2024-04-26T22:03:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.811+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 --> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8580aed50 con 0x7fb838076310 2024-04-26T22:03:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.812+0000 7fb84e000640 1 -- 172.21.15.5:0/2773875334 <== osd.3 v2:172.21.15.5:6822/3678222192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb8580aed50 con 0x7fb838076310 2024-04-26T22:03:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:54.812 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:54.812 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7fb838076310 msgr2=0x7fb8380787b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:6822/3678222192,v1:172.21.15.5:6824/3678222192] conn(0x7fb838076310 0x7fb8380787b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb83806c8f0 msgr2=0x7fb83806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fb83806c8f0 0x7fb83806edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb8580ad350 tx=0x7fb844008040 comp rx=0 tx=0).stop 2024-04-26T22:03:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 msgr2=0x7fb858145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 --2- 172.21.15.5:0/2773875334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb83c0039e0 0x7fb858145730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb848008fd0 tx=0x7fb848001120 comp rx=0 tx=0).stop 2024-04-26T22:03:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb856800640 1 -- 172.21.15.5:0/2773875334 reap_dead start 2024-04-26T22:03:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 shutdown_connections 2024-04-26T22:03:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 >> 172.21.15.5:0/2773875334 conn(0x7fb8580686c0 msgr2=0x7fb8580ba800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 shutdown_connections 2024-04-26T22:03:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:54.813+0000 7fb857200640 1 -- 172.21.15.5:0/2773875334 wait complete. 2024-04-26T22:03:54.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T22:03:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.043+0000 7fc193200640 1 Processor -- start 2024-04-26T22:03:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.043+0000 7fc193200640 1 -- start start 2024-04-26T22:03:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.044+0000 7fc193200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 0x7fc1940b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.044+0000 7fc193200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc19413f0a0 0x7fc19413f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.044+0000 7fc193200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1940b4a30 con 0x7fc1940b4650 2024-04-26T22:03:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.044+0000 7fc193200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc194145810 con 0x7fc19413f0a0 2024-04-26T22:03:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.044+0000 7fc193200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc194070740 con 0x7fc1940b0ee0 2024-04-26T22:03:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.044+0000 7fc191e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1940b4650 0x7fc194145ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45240/0 (socket says 172.21.15.5:45240) 2024-04-26T22:03:55.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc191e00640 1 -- 172.21.15.5:0/2420348723 learned_addr learned my addr 172.21.15.5:0/2420348723 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:55.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc18be00640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 0x7fc1940b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc192800640 1 --2- 172.21.15.5:0/2420348723 >> v2:172.21.15.112:3300/0 conn(0x7fc19413f0a0 0x7fc19413f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591937679 0 0) 0x7fc1940b4a30 con 0x7fc1940b4650 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc178003520 con 0x7fc1940b4650 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3218783786 0 0) 0x7fc178003520 con 0x7fc1940b4650 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 msgr2=0x7fc1940b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.045+0000 7fc191400640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 0x7fc1940b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 >> v2:172.21.15.112:3300/0 conn(0x7fc19413f0a0 msgr2=0x7fc19413f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 --2- 172.21.15.5:0/2420348723 >> v2:172.21.15.112:3300/0 conn(0x7fc19413f0a0 0x7fc19413f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1940b3720 con 0x7fc1940b4650 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fc184001670 con 0x7fc1940b4650 2024-04-26T22:03:55.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 >> v1:172.21.15.5:6789/0 conn(0x7fc1940b4650 legacy=0x7fc194145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780039b0 0x7fc178003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc178004800 0x7fc178004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 0x7fc1780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc194145810 con 0x7fc1780039b0 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc194070740 con 0x7fc178004800 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc17800ba10 con 0x7fc1940b0ee0 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc191e00640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780039b0 0x7fc178003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc192800640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 0x7fc1780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.046+0000 7fc18be00640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc178004800 0x7fc178004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.047+0000 7fc191e00640 1 -- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 msgr2=0x7fc1780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.047+0000 7fc191e00640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1940b0ee0 0x7fc1780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.047+0000 7fc191e00640 1 -- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc178004800 msgr2=0x7fc178004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.047+0000 7fc191e00640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc178004800 0x7fc178004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.047+0000 7fc191e00640 1 -- 172.21.15.5:0/2420348723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc178003520 con 0x7fc1780039b0 2024-04-26T22:03:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.047+0000 7fc18be00640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc178004800 0x7fc178004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.048+0000 7fc191e00640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780039b0 0x7fc178003dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc184007c20 tx=0x7fc178005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eaed8ffd7982850 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.048+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184007c60 con 0x7fc1780039b0 2024-04-26T22:03:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.048+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc184036070 con 0x7fc1780039b0 2024-04-26T22:03:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.048+0000 7fc191400640 1 -- 172.21.15.5:0/2420348723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184005d30 con 0x7fc1780039b0 2024-04-26T22:03:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.049+0000 7fc193200640 1 -- 172.21.15.5:0/2420348723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780039b0 msgr2=0x7fc178003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.049+0000 7fc193200640 1 --2- 172.21.15.5:0/2420348723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780039b0 0x7fc178003dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc184007c20 tx=0x7fc178005830 comp rx=0 tx=0).stop 2024-04-26T22:03:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.049+0000 7fc192800640 1 -- 172.21.15.5:0/2420348723 reap_dead start 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.049+0000 7fc193200640 1 -- 172.21.15.5:0/2420348723 shutdown_connections 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.049+0000 7fc193200640 1 -- 172.21.15.5:0/2420348723 >> 172.21.15.5:0/2420348723 conn(0x7fc19406c300 msgr2=0x7fc19406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.049+0000 7fc193200640 1 -- 172.21.15.5:0/2420348723 shutdown_connections 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.049+0000 7fc193200640 1 -- 172.21.15.5:0/2420348723 wait complete. 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.050+0000 7fc193200640 1 Processor -- start 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.051+0000 7fc193200640 1 -- start start 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.051+0000 7fc193200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1780039b0 0x7fc194070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.051+0000 7fc193200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941e1c50 0x7fc1941e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.051+0000 7fc193200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194142130 0x7fc1941425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.051+0000 7fc193200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1940b3010 con 0x7fc194142130 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.051+0000 7fc193200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc1940b0ad0 con 0x7fc1941e1c50 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.051+0000 7fc193200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc1940b3190 con 0x7fc1780039b0 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194142130 0x7fc1941425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194142130 0x7fc1941425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53938/0 (socket says 172.21.15.5:53938) 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 -- 172.21.15.5:0/189574957 learned_addr learned my addr 172.21.15.5:0/189574957 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc18be00640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941e1c50 0x7fc1941e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc191e00640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1780039b0 0x7fc194070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 -- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1780039b0 msgr2=0x7fc194070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1780039b0 0x7fc194070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 -- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941e1c50 msgr2=0x7fc1941e12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941e1c50 0x7fc1941e12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.052+0000 7fc192800640 1 -- 172.21.15.5:0/189574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc194073ab0 con 0x7fc194142130 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.053+0000 7fc192800640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194142130 0x7fc1941425a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc1940b5e80 tx=0x7fc18c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.053+0000 7fc18a000640 1 -- 172.21.15.5:0/189574957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c011e10 con 0x7fc194142130 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.053+0000 7fc18a000640 1 -- 172.21.15.5:0/189574957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c01b070 con 0x7fc194142130 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.053+0000 7fc18a000640 1 -- 172.21.15.5:0/189574957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c003990 con 0x7fc194142130 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.053+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1940729f0 con 0x7fc194142130 2024-04-26T22:03:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.053+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc194145040 con 0x7fc194142130 2024-04-26T22:03:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.054+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc194075db0 con 0x7fc194142130 2024-04-26T22:03:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.055+0000 7fc18a000640 1 -- 172.21.15.5:0/189574957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc18c005d10 con 0x7fc194142130 2024-04-26T22:03:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.057+0000 7fc18a000640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc17006c970 0x7fc17006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.057+0000 7fc18a000640 1 -- 172.21.15.5:0/189574957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc18c08c2c0 con 0x7fc194142130 2024-04-26T22:03:55.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.057+0000 7fc191e00640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc17006c970 0x7fc17006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.059+0000 7fc191e00640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc17006c970 0x7fc17006ee30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc184035000 tx=0x7fc184009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.061+0000 7fc18a000640 1 -- 172.21.15.5:0/189574957 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc18c025020 con 0x7fc194142130 2024-04-26T22:03:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.270+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc1941e1950 con 0x7fc17006c970 2024-04-26T22:03:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T22:03:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.272+0000 7fc18a000640 1 -- 172.21.15.5:0/189574957 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc184036050 con 0x7fc17006c970 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc17006c970 msgr2=0x7fc17006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc17006c970 0x7fc17006ee30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc184035000 tx=0x7fc184009030 comp rx=0 tx=0).stop 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194142130 msgr2=0x7fc1941425a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194142130 0x7fc1941425a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc1940b5e80 tx=0x7fc18c0115a0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 shutdown_connections 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc17006c970 0x7fc17006ee30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc194142130 0x7fc1941425a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1941e1c50 0x7fc1941e12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 --2- 172.21.15.5:0/189574957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1780039b0 0x7fc194070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 >> 172.21.15.5:0/189574957 conn(0x7fc19406c300 msgr2=0x7fc194075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 shutdown_connections 2024-04-26T22:03:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.275+0000 7fc193200640 1 -- 172.21.15.5:0/189574957 wait complete. 2024-04-26T22:03:55.297 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T22:03:55.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.517+0000 7f7ea2000640 1 Processor -- start 2024-04-26T22:03:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.517+0000 7f7ea2000640 1 -- start start 2024-04-26T22:03:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.518+0000 7f7ea2000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c06cc80 0x7f7e9c070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.518+0000 7f7ea2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e9c0b46d0 0x7f7e9c0738b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.518+0000 7f7ea2000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e9c071de0 con 0x7f7e9c073df0 2024-04-26T22:03:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.519+0000 7f7ea2000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9c140e60 con 0x7f7e9c0b46d0 2024-04-26T22:03:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.519+0000 7f7ea2000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9c072050 con 0x7f7e9c06cc80 2024-04-26T22:03:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.519+0000 7f7e9be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e9c073df0 0x7f7e9c149c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45244/0 (socket says 172.21.15.5:45244) 2024-04-26T22:03:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.519+0000 7f7e9be00640 1 -- 172.21.15.5:0/2424758375 learned_addr learned my addr 172.21.15.5:0/2424758375 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.519+0000 7f7e9aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e9c0b46d0 0x7f7e9c0738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.519+0000 7f7e9b400640 1 --2- 172.21.15.5:0/2424758375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c06cc80 0x7f7e9c070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.520+0000 7f7e9a000640 1 -- 172.21.15.5:0/2424758375 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653045948 0 0) 0x7f7e9c071de0 con 0x7f7e9c073df0 2024-04-26T22:03:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.520+0000 7f7e9aa00640 1 -- 172.21.15.5:0/2424758375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c06cc80 msgr2=0x7f7e9c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.520+0000 7f7e9aa00640 1 --2- 172.21.15.5:0/2424758375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c06cc80 0x7f7e9c070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.520+0000 7f7e9aa00640 1 -- 172.21.15.5:0/2424758375 >> v1:172.21.15.5:6789/0 conn(0x7f7e9c073df0 legacy=0x7f7e9c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.520+0000 7f7e9aa00640 1 -- 172.21.15.5:0/2424758375 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c06d060 con 0x7f7e9c0b46d0 2024-04-26T22:03:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.521+0000 7f7e9aa00640 1 --2- 172.21.15.5:0/2424758375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c0b46d0 0x7f7e9c0738b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e880097a0 tx=0x7f7e8802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbc2be142da285f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.521+0000 7f7e9a000640 1 -- 172.21.15.5:0/2424758375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88037070 con 0x7f7e9c0b46d0 2024-04-26T22:03:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.521+0000 7f7e9a000640 1 -- 172.21.15.5:0/2424758375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8802adb0 con 0x7f7e9c0b46d0 2024-04-26T22:03:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.521+0000 7f7e9a000640 1 -- 172.21.15.5:0/2424758375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88032660 con 0x7f7e9c0b46d0 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 -- 172.21.15.5:0/2424758375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c0b46d0 msgr2=0x7f7e9c0738b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 --2- 172.21.15.5:0/2424758375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c0b46d0 0x7f7e9c0738b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e880097a0 tx=0x7f7e8802a060 comp rx=0 tx=0).stop 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 -- 172.21.15.5:0/2424758375 shutdown_connections 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 --2- 172.21.15.5:0/2424758375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c0b46d0 0x7f7e9c0738b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 --2- 172.21.15.5:0/2424758375 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c06cc80 0x7f7e9c070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 -- 172.21.15.5:0/2424758375 >> 172.21.15.5:0/2424758375 conn(0x7f7e9c0ba330 msgr2=0x7f7e9c06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 -- 172.21.15.5:0/2424758375 shutdown_connections 2024-04-26T22:03:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.522+0000 7f7ea2000640 1 -- 172.21.15.5:0/2424758375 wait complete. 2024-04-26T22:03:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.523+0000 7f7ea2000640 1 Processor -- start 2024-04-26T22:03:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.524+0000 7f7ea2000640 1 -- start start 2024-04-26T22:03:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.524+0000 7f7ea2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c06cc80 0x7f7e9c0b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.524+0000 7f7ea2000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c073df0 0x7f7e9c1e1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.524+0000 7f7ea2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e9c0b46d0 0x7f7e9c13c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.524+0000 7f7ea2000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c146c40 con 0x7f7e9c06cc80 2024-04-26T22:03:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.524+0000 7f7ea2000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c146960 con 0x7f7e9c0b46d0 2024-04-26T22:03:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.524+0000 7f7ea2000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9c146f20 con 0x7f7e9c073df0 2024-04-26T22:03:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c06cc80 0x7f7e9c0b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c06cc80 0x7f7e9c0b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53962/0 (socket says 172.21.15.5:53962) 2024-04-26T22:03:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 -- 172.21.15.5:0/1306756034 learned_addr learned my addr 172.21.15.5:0/1306756034 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 -- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c073df0 msgr2=0x7f7e9c1e1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7e9c073df0 0x7f7e9c1e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 -- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e9c0b46d0 msgr2=0x7f7e9c13c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e9c0b46d0 0x7f7e9c13c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 -- 172.21.15.5:0/1306756034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c143030 con 0x7f7e9c06cc80 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.525+0000 7f7e9b400640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c06cc80 0x7f7e9c0b11d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00d830 tx=0x7f7e8c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.526+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00b6c0 con 0x7f7e9c06cc80 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.526+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c019070 con 0x7f7e9c06cc80 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.526+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00ba80 con 0x7f7e9c06cc80 2024-04-26T22:03:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.526+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9c0b1710 con 0x7f7e9c06cc80 2024-04-26T22:03:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.526+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9c1cc7c0 con 0x7f7e9c06cc80 2024-04-26T22:03:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.527+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e9c143530 con 0x7f7e9c06cc80 2024-04-26T22:03:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.528+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e8c01e460 con 0x7f7e9c06cc80 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.529+0000 7f7e93400640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7e7c06c940 0x7f7e7c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.529+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7e8c08c4e0 con 0x7f7e9c06cc80 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.530+0000 7f7e93400640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f7e7c0763d0 0x7f7e7c078870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.530+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 --> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e7c078f40 con 0x7f7e7c0763d0 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.530+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7e8c093050 con 0x7f7e9c06cc80 2024-04-26T22:03:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.530+0000 7f7e9aa00640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7e7c06c940 0x7f7e7c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.530+0000 7f7e9be00640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f7e7c0763d0 0x7f7e7c078870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.531+0000 7f7e9be00640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f7e7c0763d0 0x7f7e7c078870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.532+0000 7f7e9aa00640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7e7c06c940 0x7f7e7c06ee00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e88034000 tx=0x7f7e8802c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.534+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== osd.4 v2:172.21.15.112:6824/2443506001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e7c078f40 con 0x7f7e7c0763d0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.548+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 --> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7e9c075db0 con 0x7f7e7c0763d0 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.549+0000 7f7e93400640 1 -- 172.21.15.5:0/1306756034 <== osd.4 v2:172.21.15.112:6824/2443506001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7e9c075db0 con 0x7f7e7c0763d0 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:55.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f7e7c0763d0 msgr2=0x7f7e7c078870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6824/2443506001,v1:172.21.15.112:6825/2443506001] conn(0x7f7e7c0763d0 0x7f7e7c078870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7e7c06c940 msgr2=0x7f7e7c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f7e7c06c940 0x7f7e7c06ee00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e88034000 tx=0x7f7e8802c000 comp rx=0 tx=0).stop 2024-04-26T22:03:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c06cc80 msgr2=0x7f7e9c0b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 --2- 172.21.15.5:0/1306756034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e9c06cc80 0x7f7e9c0b11d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00d830 tx=0x7f7e8c00dcf0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7e9be00640 1 -- 172.21.15.5:0/1306756034 reap_dead start 2024-04-26T22:03:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 shutdown_connections 2024-04-26T22:03:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 >> 172.21.15.5:0/1306756034 conn(0x7f7e9c0ba330 msgr2=0x7f7e9c0af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 shutdown_connections 2024-04-26T22:03:55.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.550+0000 7f7ea2000640 1 -- 172.21.15.5:0/1306756034 wait complete. 2024-04-26T22:03:55.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T22:03:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.788+0000 7f49ae000640 1 Processor -- start 2024-04-26T22:03:55.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.788+0000 7f49ae000640 1 -- start start 2024-04-26T22:03:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.789+0000 7f49ae000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49a80b0ee0 0x7f49a80b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.789+0000 7f49ae000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a813f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.789+0000 7f49ae000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a80b4a30 con 0x7f49a80b4650 2024-04-26T22:03:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.789+0000 7f49ae000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f49a8145810 con 0x7f49a80b0ee0 2024-04-26T22:03:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.789+0000 7f49ae000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f49a8070740 con 0x7f49a813f0a0 2024-04-26T22:03:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.790+0000 7f49ad600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a813f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.790+0000 7f499fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49a80b0ee0 0x7f49a80b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.790+0000 7f49acc00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f49a80b4650 0x7f49a8145ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.5:39550/0 (socket says 172.21.15.5:39550) 2024-04-26T22:03:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.790+0000 7f49ad600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a813f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.5:41404/0 (socket says 172.21.15.5:41404) 2024-04-26T22:03:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.790+0000 7f49acc00640 1 -- 172.21.15.5:0/1383760636 learned_addr learned my addr 172.21.15.5:0/1383760636 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.791+0000 7f499fe00640 1 -- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 msgr2=0x7f49a813f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.791+0000 7f499fe00640 1 --2- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a813f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.791+0000 7f499fe00640 1 -- 172.21.15.5:0/1383760636 >> v1:172.21.15.112:6789/0 conn(0x7f49a80b4650 legacy=0x7f49a8145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.791+0000 7f499fe00640 1 -- 172.21.15.5:0/1383760636 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a80b3720 con 0x7f49a80b0ee0 2024-04-26T22:03:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.791+0000 7f49a7e00640 1 -- 172.21.15.5:0/1383760636 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200937717 0 0) 0x7f49a80b4a30 con 0x7f49a80b4650 2024-04-26T22:03:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.791+0000 7f49ad600640 1 --2- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a813f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:03:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.793+0000 7f499fe00640 1 --2- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 0x7f49a80b3010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49980097a0 tx=0x7f499802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace55ee7d9e0e59a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.793+0000 7f49a7e00640 1 -- 172.21.15.5:0/1383760636 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998037070 con 0x7f49a80b0ee0 2024-04-26T22:03:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.793+0000 7f49a7e00640 1 -- 172.21.15.5:0/1383760636 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499802ae50 con 0x7f49a80b0ee0 2024-04-26T22:03:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.793+0000 7f49a7e00640 1 -- 172.21.15.5:0/1383760636 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998032660 con 0x7f49a80b0ee0 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 -- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 msgr2=0x7f49a80b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 --2- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 0x7f49a80b3010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49980097a0 tx=0x7f499802a100 comp rx=0 tx=0).stop 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 -- 172.21.15.5:0/1383760636 shutdown_connections 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 --2- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a813f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 --2- 172.21.15.5:0/1383760636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 0x7f49a80b3010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 -- 172.21.15.5:0/1383760636 >> 172.21.15.5:0/1383760636 conn(0x7f49a806c300 msgr2=0x7f49a806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 -- 172.21.15.5:0/1383760636 shutdown_connections 2024-04-26T22:03:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.794+0000 7f49ae000640 1 -- 172.21.15.5:0/1383760636 wait complete. 2024-04-26T22:03:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.796+0000 7f49ae000640 1 Processor -- start 2024-04-26T22:03:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.796+0000 7f49ae000640 1 -- start start 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49ae000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 0x7f49a8135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49ae000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a80b4650 0x7f49a8144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49ae000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a81dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49ae000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49a80b4c70 con 0x7f49a80b4650 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49ae000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49a80b0ad0 con 0x7f49a80b0ee0 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49ae000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f49a80b4df0 con 0x7f49a813f0a0 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f499fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a80b4650 0x7f49a8144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f499fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a80b4650 0x7f49a8144730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53968/0 (socket says 172.21.15.5:53968) 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f499fe00640 1 -- 172.21.15.5:0/3590489939 learned_addr learned my addr 172.21.15.5:0/3590489939 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49acc00640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 0x7f49a8135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.797+0000 7f49ad600640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a81dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f499fe00640 1 -- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 msgr2=0x7f49a81dcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f499fe00640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a81dcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f499fe00640 1 -- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 msgr2=0x7f49a8135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f499fe00640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 0x7f49a8135e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f499fe00640 1 -- 172.21.15.5:0/3590489939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a8074220 con 0x7f49a80b4650 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f499fe00640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a80b4650 0x7f49a8144730 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f49980097a0 tx=0x7f49980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f49a5600640 1 -- 172.21.15.5:0/3590489939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998037040 con 0x7f49a80b4650 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f49a5600640 1 -- 172.21.15.5:0/3590489939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4998004030 con 0x7f49a80b4650 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.798+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a8136cf0 con 0x7f49a80b4650 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.799+0000 7f49a5600640 1 -- 172.21.15.5:0/3590489939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998006e10 con 0x7f49a80b4650 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.799+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a81372b0 con 0x7f49a80b4650 2024-04-26T22:03:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.800+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a8075db0 con 0x7f49a80b4650 2024-04-26T22:03:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.801+0000 7f49a5600640 1 -- 172.21.15.5:0/3590489939 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4998003610 con 0x7f49a80b4650 2024-04-26T22:03:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.802+0000 7f49a5600640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f498406c8f0 0x7f498406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.802+0000 7f49a5600640 1 -- 172.21.15.5:0/3590489939 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f49980ac9d0 con 0x7f49a80b4650 2024-04-26T22:03:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.803+0000 7f49acc00640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f498406c8f0 0x7f498406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.804+0000 7f49acc00640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f498406c8f0 0x7f498406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4990000f60 tx=0x7f4990007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:55.806+0000 7f49a5600640 1 -- 172.21.15.5:0/3590489939 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f499804c070 con 0x7f49a80b4650 2024-04-26T22:03:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.011+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f49a8142920 con 0x7f498406c8f0 2024-04-26T22:03:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.012+0000 7f49a5600640 1 -- 172.21.15.5:0/3590489939 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f49a8142920 con 0x7f498406c8f0 2024-04-26T22:03:56.012 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f498406c8f0 msgr2=0x7f498406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f498406c8f0 0x7f498406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4990000f60 tx=0x7f4990007d50 comp rx=0 tx=0).stop 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a80b4650 msgr2=0x7f49a8144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a80b4650 0x7f49a8144730 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f49980097a0 tx=0x7f49980046c0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 shutdown_connections 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49a813f0a0 0x7f49a81dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f498406c8f0 0x7f498406edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a80b4650 0x7f49a8144730 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 --2- 172.21.15.5:0/3590489939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49a80b0ee0 0x7f49a8135e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 >> 172.21.15.5:0/3590489939 conn(0x7f49a806c300 msgr2=0x7f49a80b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 shutdown_connections 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.015+0000 7f49ae000640 1 -- 172.21.15.5:0/3590489939 wait complete. 2024-04-26T22:03:56.034 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T22:03:56.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.250+0000 7ff587e00640 1 Processor -- start 2024-04-26T22:03:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.251+0000 7ff587e00640 1 -- start start 2024-04-26T22:03:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff587e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5880b6c60 0x7ff5881421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff587e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff58814c270 0x7ff588142710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff587e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5880b7f10 con 0x7ff5880be740 2024-04-26T22:03:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff587e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff5880b5e90 con 0x7ff5880b6c60 2024-04-26T22:03:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff587e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff5880beb20 con 0x7ff58814c270 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff586000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5880b6c60 0x7ff5881421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff586a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5880be740 0x7ff58814bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45254/0 (socket says 172.21.15.5:45254) 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff586a00640 1 -- 172.21.15.5:0/319404914 learned_addr learned my addr 172.21.15.5:0/319404914 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.252+0000 7ff586000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5880b6c60 0x7ff5881421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53980/0 (socket says 172.21.15.5:53980) 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.253+0000 7ff587400640 1 --2- 172.21.15.5:0/319404914 >> v2:172.21.15.112:3300/0 conn(0x7ff58814c270 0x7ff588142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.253+0000 7ff586000640 1 -- 172.21.15.5:0/319404914 >> v2:172.21.15.112:3300/0 conn(0x7ff58814c270 msgr2=0x7ff588142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.253+0000 7ff586000640 1 --2- 172.21.15.5:0/319404914 >> v2:172.21.15.112:3300/0 conn(0x7ff58814c270 0x7ff588142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.253+0000 7ff586000640 1 -- 172.21.15.5:0/319404914 >> v1:172.21.15.5:6789/0 conn(0x7ff5880be740 legacy=0x7ff58814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.253+0000 7ff586000640 1 -- 172.21.15.5:0/319404914 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5880b5840 con 0x7ff5880b6c60 2024-04-26T22:03:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.254+0000 7ff586000640 1 --2- 172.21.15.5:0/319404914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5880b6c60 0x7ff5881421d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff588069050 tx=0x7ff57002a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ba194c10bd86c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.254+0000 7ff585600640 1 -- 172.21.15.5:0/319404914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570007740 con 0x7ff5880b6c60 2024-04-26T22:03:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.254+0000 7ff585600640 1 -- 172.21.15.5:0/319404914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5700078e0 con 0x7ff5880b6c60 2024-04-26T22:03:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.254+0000 7ff585600640 1 -- 172.21.15.5:0/319404914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570007cb0 con 0x7ff5880b6c60 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 -- 172.21.15.5:0/319404914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5880b6c60 msgr2=0x7ff5881421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 --2- 172.21.15.5:0/319404914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5880b6c60 0x7ff5881421d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff588069050 tx=0x7ff57002a550 comp rx=0 tx=0).stop 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 -- 172.21.15.5:0/319404914 shutdown_connections 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 --2- 172.21.15.5:0/319404914 >> v2:172.21.15.112:3300/0 conn(0x7ff58814c270 0x7ff588142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 --2- 172.21.15.5:0/319404914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5880b6c60 0x7ff5881421d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 -- 172.21.15.5:0/319404914 >> 172.21.15.5:0/319404914 conn(0x7ff5880686c0 msgr2=0x7ff5880bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 -- 172.21.15.5:0/319404914 shutdown_connections 2024-04-26T22:03:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.255+0000 7ff587e00640 1 -- 172.21.15.5:0/319404914 wait complete. 2024-04-26T22:03:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.256+0000 7ff587e00640 1 Processor -- start 2024-04-26T22:03:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.257+0000 7ff587e00640 1 -- start start 2024-04-26T22:03:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.257+0000 7ff587e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5880b6c60 0x7ff58814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.257+0000 7ff587e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5880be740 0x7ff588144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.257+0000 7ff587e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58814c270 0x7ff5881451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.257+0000 7ff587e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff5880b55e0 con 0x7ff58814c270 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.257+0000 7ff587e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff5880b5460 con 0x7ff5880be740 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.257+0000 7ff587e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff5880ba480 con 0x7ff5880b6c60 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58814c270 0x7ff5881451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58814c270 0x7ff5881451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53994/0 (socket says 172.21.15.5:53994) 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 -- 172.21.15.5:0/950124592 learned_addr learned my addr 172.21.15.5:0/950124592 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff586a00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5880b6c60 0x7ff58814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff586000640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5880be740 0x7ff588144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 -- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5880b6c60 msgr2=0x7ff58814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5880b6c60 0x7ff58814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 -- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5880be740 msgr2=0x7ff588144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5880be740 0x7ff588144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff587400640 1 -- 172.21.15.5:0/950124592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff588144180 con 0x7ff58814c270 2024-04-26T22:03:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.258+0000 7ff586000640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5880be740 0x7ff588144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.259+0000 7ff587400640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58814c270 0x7ff5881451a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff58000d600 tx=0x7ff58000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.259+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5800125f0 con 0x7ff58814c270 2024-04-26T22:03:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.259+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff580019070 con 0x7ff58814c270 2024-04-26T22:03:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.259+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58813c9a0 con 0x7ff58814c270 2024-04-26T22:03:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.259+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5800129f0 con 0x7ff58814c270 2024-04-26T22:03:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.259+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58814b530 con 0x7ff58814c270 2024-04-26T22:03:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.260+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff588075db0 con 0x7ff58814c270 2024-04-26T22:03:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.261+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff580012b90 con 0x7ff58814c270 2024-04-26T22:03:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.262+0000 7ff57ea00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff56406c8f0 0x7ff56406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.262+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff58008c390 con 0x7ff58814c270 2024-04-26T22:03:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.263+0000 7ff57ea00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7ff564076300 0x7ff5640787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.263+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 --> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff564078e70 con 0x7ff564076300 2024-04-26T22:03:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.263+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff580093050 con 0x7ff58814c270 2024-04-26T22:03:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.263+0000 7ff586a00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff56406c8f0 0x7ff56406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.263+0000 7ff586000640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7ff564076300 0x7ff5640787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.264+0000 7ff586a00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff56406c8f0 0x7ff56406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff578000f60 tx=0x7ff578009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.265+0000 7ff586000640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7ff564076300 0x7ff5640787a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.267+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== osd.5 v2:172.21.15.112:6808/2214364032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff564078e70 con 0x7ff564076300 2024-04-26T22:03:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.283+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 --> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff5880bc8c0 con 0x7ff564076300 2024-04-26T22:03:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.284+0000 7ff57ea00640 1 -- 172.21.15.5:0/950124592 <== osd.5 v2:172.21.15.112:6808/2214364032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff5880bc8c0 con 0x7ff564076300 2024-04-26T22:03:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:56.284 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.284+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7ff564076300 msgr2=0x7ff5640787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6808/2214364032,v1:172.21.15.112:6809/2214364032] conn(0x7ff564076300 0x7ff5640787a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff56406c8f0 msgr2=0x7ff56406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7ff56406c8f0 0x7ff56406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff578000f60 tx=0x7ff578009040 comp rx=0 tx=0).stop 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58814c270 msgr2=0x7ff5881451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 --2- 172.21.15.5:0/950124592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58814c270 0x7ff5881451a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff58000d600 tx=0x7ff58000dac0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587400640 1 -- 172.21.15.5:0/950124592 reap_dead start 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 shutdown_connections 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 >> 172.21.15.5:0/950124592 conn(0x7ff5880686c0 msgr2=0x7ff588148d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 shutdown_connections 2024-04-26T22:03:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.285+0000 7ff587e00640 1 -- 172.21.15.5:0/950124592 wait complete. 2024-04-26T22:03:56.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T22:03:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.504+0000 7fcbda800640 1 Processor -- start 2024-04-26T22:03:56.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.504+0000 7fcbda800640 1 -- start start 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbda800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbd40bae80 0x7fcbd40b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbda800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4142310 0x7fcbd4142770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbda800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd40bb260 con 0x7fcbd4148600 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbda800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcbd40b6270 con 0x7fcbd40bae80 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbda800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd40b6550 con 0x7fcbd4142310 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbd9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbd40bae80 0x7fcbd40b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbd9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcbd40bae80 0x7fcbd40b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54006/0 (socket says 172.21.15.5:54006) 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.506+0000 7fcbd9400640 1 -- 172.21.15.5:0/830902177 learned_addr learned my addr 172.21.15.5:0/830902177 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.507+0000 7fcbd8a00640 1 --2- 172.21.15.5:0/830902177 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4142310 0x7fcbd4142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.507+0000 7fcbd9400640 1 -- 172.21.15.5:0/830902177 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4142310 msgr2=0x7fcbd4142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.507+0000 7fcbd9400640 1 --2- 172.21.15.5:0/830902177 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4142310 0x7fcbd4142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.507+0000 7fcbd9400640 1 -- 172.21.15.5:0/830902177 >> v1:172.21.15.112:6789/0 conn(0x7fcbd4148600 legacy=0x7fcbd4148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.507+0000 7fcbd9400640 1 -- 172.21.15.5:0/830902177 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd40b6830 con 0x7fcbd40bae80 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.508+0000 7fcbd9400640 1 --2- 172.21.15.5:0/830902177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd40b57d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009870 tx=0x7fcbc802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4353d903de4ad12b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.508+0000 7fcbd3e00640 1 -- 172.21.15.5:0/830902177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8037070 con 0x7fcbd40bae80 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.508+0000 7fcbd3e00640 1 -- 172.21.15.5:0/830902177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc8032440 con 0x7fcbd40bae80 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.508+0000 7fcbd3e00640 1 -- 172.21.15.5:0/830902177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8032810 con 0x7fcbd40bae80 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 -- 172.21.15.5:0/830902177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 msgr2=0x7fcbd40b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 --2- 172.21.15.5:0/830902177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd40b57d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009870 tx=0x7fcbc802a180 comp rx=0 tx=0).stop 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 -- 172.21.15.5:0/830902177 shutdown_connections 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 --2- 172.21.15.5:0/830902177 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4142310 0x7fcbd4142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 --2- 172.21.15.5:0/830902177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd40b57d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 -- 172.21.15.5:0/830902177 >> 172.21.15.5:0/830902177 conn(0x7fcbd40684b0 msgr2=0x7fcbd40688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 -- 172.21.15.5:0/830902177 shutdown_connections 2024-04-26T22:03:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.509+0000 7fcbda800640 1 -- 172.21.15.5:0/830902177 wait complete. 2024-04-26T22:03:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.511+0000 7fcbda800640 1 Processor -- start 2024-04-26T22:03:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.511+0000 7fcbda800640 1 -- start start 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbda800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbda800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4142310 0x7fcbd41e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbda800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4148600 0x7fcbd41d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbda800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd4152e10 con 0x7fcbd40bae80 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbda800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd40ba3a0 con 0x7fcbd4142310 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbda800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd4152f90 con 0x7fcbd4148600 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd414c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd414c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54016/0 (socket says 172.21.15.5:54016) 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9400640 1 -- 172.21.15.5:0/878394281 learned_addr learned my addr 172.21.15.5:0/878394281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9e00640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4148600 0x7fcbd41d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd8a00640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4142310 0x7fcbd41e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9400640 1 -- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4148600 msgr2=0x7fcbd41d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9400640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4148600 0x7fcbd41d7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9400640 1 -- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4142310 msgr2=0x7fcbd41e19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.512+0000 7fcbd9400640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4142310 0x7fcbd41e19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbd9400640 1 -- 172.21.15.5:0/878394281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd4139fc0 con 0x7fcbd40bae80 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbd8a00640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4142310 0x7fcbd41e19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbd9400640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd414c290 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8000c00 tx=0x7fcbc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbd1600640 1 -- 172.21.15.5:0/878394281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8037040 con 0x7fcbd40bae80 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbd1600640 1 -- 172.21.15.5:0/878394281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc8042070 con 0x7fcbd40bae80 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd413b9b0 con 0x7fcbd40bae80 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbd1600640 1 -- 172.21.15.5:0/878394281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8030bd0 con 0x7fcbd40bae80 2024-04-26T22:03:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.513+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd414b460 con 0x7fcbd40bae80 2024-04-26T22:03:56.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.515+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd4075db0 con 0x7fcbd40bae80 2024-04-26T22:03:56.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.516+0000 7fcbd1600640 1 -- 172.21.15.5:0/878394281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcbc8047460 con 0x7fcbd40bae80 2024-04-26T22:03:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.517+0000 7fcbd1600640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcbb406c8f0 0x7fcbb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.517+0000 7fcbd1600640 1 -- 172.21.15.5:0/878394281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fcbc80acbe0 con 0x7fcbd40bae80 2024-04-26T22:03:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.518+0000 7fcbd8a00640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcbb406c8f0 0x7fcbb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.519+0000 7fcbd8a00640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcbb406c8f0 0x7fcbb406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4139120 tx=0x7fcbc0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.521+0000 7fcbd1600640 1 -- 172.21.15.5:0/878394281 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcbc807ac00 con 0x7fcbd40bae80 2024-04-26T22:03:56.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.735+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fcbd413bb80 con 0x7fcbb406c8f0 2024-04-26T22:03:56.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.736+0000 7fcbd1600640 1 -- 172.21.15.5:0/878394281 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcbd413bb80 con 0x7fcbb406c8f0 2024-04-26T22:03:56.736 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcbb406c8f0 msgr2=0x7fcbb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcbb406c8f0 0x7fcbb406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4139120 tx=0x7fcbc0008040 comp rx=0 tx=0).stop 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 msgr2=0x7fcbd414c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd414c290 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8000c00 tx=0x7fcbc80046c0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 shutdown_connections 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbd4148600 0x7fcbd41d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4142310 0x7fcbd41e19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fcbb406c8f0 0x7fcbb406edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 --2- 172.21.15.5:0/878394281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd40bae80 0x7fcbd414c290 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 >> 172.21.15.5:0/878394281 conn(0x7fcbd40684b0 msgr2=0x7fcbd4146400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 shutdown_connections 2024-04-26T22:03:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.739+0000 7fcbda800640 1 -- 172.21.15.5:0/878394281 wait complete. 2024-04-26T22:03:56.758 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T22:03:56.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.968+0000 7f8c57800640 1 Processor -- start 2024-04-26T22:03:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.968+0000 7f8c57800640 1 -- start start 2024-04-26T22:03:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.970+0000 7f8c57800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c500b8460 0x7f8c5006e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.970+0000 7f8c57800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c500b94c0 con 0x7f8c500b90e0 2024-04-26T22:03:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.970+0000 7f8c57800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c500b6df0 con 0x7f8c50142bb0 2024-04-26T22:03:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.970+0000 7f8c57800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8c500b70d0 con 0x7f8c500b8460 2024-04-26T22:03:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.970+0000 7f8c54e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c500b90e0 0x7f8c501424a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45260/0 (socket says 172.21.15.5:45260) 2024-04-26T22:03:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.970+0000 7f8c54e00640 1 -- 172.21.15.5:0/3203038700 learned_addr learned my addr 172.21.15.5:0/3203038700 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4fe00640 1 --2- 172.21.15.5:0/3203038700 >> v2:172.21.15.112:3300/0 conn(0x7f8c500b8460 0x7f8c5006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3137004792 0 0) 0x7f8c500b94c0 con 0x7f8c500b90e0 2024-04-26T22:03:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c38003520 con 0x7f8c500b90e0 2024-04-26T22:03:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 627661427 0 0) 0x7f8c38003520 con 0x7f8c500b90e0 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 >> v2:172.21.15.112:3300/0 conn(0x7f8c500b8460 msgr2=0x7f8c5006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 --2- 172.21.15.5:0/3203038700 >> v2:172.21.15.112:3300/0 conn(0x7f8c500b8460 0x7f8c5006e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 >> v1:172.21.15.112:6789/0 conn(0x7f8c50142bb0 legacy=0x7f8c50152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c500b73b0 con 0x7f8c500b90e0 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f8c44001670 con 0x7f8c500b90e0 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 >> v1:172.21.15.5:6789/0 conn(0x7f8c500b90e0 legacy=0x7f8c501424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38003a00 0x7f8c38003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38004800 0x7f8c38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.971+0000 7f8c4f400640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38005210 0x7f8c3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8c500b70d0 con 0x7f8c38003a00 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3800c160 con 0x7f8c38005210 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3800c360 con 0x7f8c38004800 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c54e00640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38003a00 0x7f8c38003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c4fe00640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38004800 0x7f8c38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c55800640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38005210 0x7f8c3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c54e00640 1 -- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38004800 msgr2=0x7f8c38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c54e00640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38004800 0x7f8c38004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c54e00640 1 -- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38005210 msgr2=0x7f8c3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c54e00640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38005210 0x7f8c3800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c54e00640 1 -- 172.21.15.5:0/3203038700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c38003520 con 0x7f8c38003a00 2024-04-26T22:03:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c55800640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c38005210 0x7f8c3800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.972+0000 7f8c55800640 1 -- 172.21.15.5:0/3203038700 reap_dead start 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.973+0000 7f8c54e00640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38003a00 0x7f8c38003e20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c44007fd0 tx=0x7f8c38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88cdb266cded71f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.973+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44007c20 con 0x7f8c38003a00 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c44005af0 con 0x7f8c38003a00 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c4f400640 1 -- 172.21.15.5:0/3203038700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44007070 con 0x7f8c38003a00 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c57800640 1 -- 172.21.15.5:0/3203038700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38003a00 msgr2=0x7f8c38003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c57800640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38003a00 0x7f8c38003e20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c44007fd0 tx=0x7f8c38005830 comp rx=0 tx=0).stop 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c57800640 1 -- 172.21.15.5:0/3203038700 shutdown_connections 2024-04-26T22:03:56.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c57800640 1 --2- 172.21.15.5:0/3203038700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c38003a00 0x7f8c38003e20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c57800640 1 -- 172.21.15.5:0/3203038700 >> 172.21.15.5:0/3203038700 conn(0x7f8c50068480 msgr2=0x7f8c50068890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.974+0000 7f8c57800640 1 -- 172.21.15.5:0/3203038700 shutdown_connections 2024-04-26T22:03:56.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.975+0000 7f8c57800640 1 -- 172.21.15.5:0/3203038700 wait complete. 2024-04-26T22:03:56.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.976+0000 7f8c57800640 1 Processor -- start 2024-04-26T22:03:56.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.976+0000 7f8c57800640 1 -- start start 2024-04-26T22:03:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.977+0000 7f8c57800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38003a00 0x7f8c50141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.977+0000 7f8c57800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5013fe40 0x7f8c501de530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.977+0000 7f8c57800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c50140950 0x7f8c501dea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.977+0000 7f8c57800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8c500b6a50 con 0x7f8c50140950 2024-04-26T22:03:56.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.977+0000 7f8c57800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c500b68d0 con 0x7f8c5013fe40 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.977+0000 7f8c57800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c500b6bd0 con 0x7f8c38003a00 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.977+0000 7f8c55800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c50140950 0x7f8c501dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c50140950 0x7f8c501dea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54024/0 (socket says 172.21.15.5:54024) 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 -- 172.21.15.5:0/1299231547 learned_addr learned my addr 172.21.15.5:0/1299231547 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c4fe00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5013fe40 0x7f8c501de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c54e00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38003a00 0x7f8c50141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 -- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38003a00 msgr2=0x7f8c50141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c38003a00 0x7f8c50141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 -- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5013fe40 msgr2=0x7f8c501de530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5013fe40 0x7f8c501de530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 -- 172.21.15.5:0/1299231547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c500b48f0 con 0x7f8c50140950 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.978+0000 7f8c55800640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c50140950 0x7f8c501dea70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8c5006f5c0 tx=0x7f8c4800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.979+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48018070 con 0x7f8c50140950 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.979+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c48003da0 con 0x7f8c50140950 2024-04-26T22:03:56.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.979+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c480052b0 con 0x7f8c50140950 2024-04-26T22:03:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.979+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c500b33d0 con 0x7f8c50140950 2024-04-26T22:03:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.979+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c500b36b0 con 0x7f8c50140950 2024-04-26T22:03:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.980+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c500b31f0 con 0x7f8c50140950 2024-04-26T22:03:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.981+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c4801b070 con 0x7f8c50140950 2024-04-26T22:03:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.982+0000 7f8c4cc00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8c3006c920 0x7f8c3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.982+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8c4808b4a0 con 0x7f8c50140950 2024-04-26T22:03:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.982+0000 7f8c4cc00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7f8c30076330 0x7f8c300787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.982+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 --> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c48016e70 con 0x7f8c30076330 2024-04-26T22:03:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.982+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8c48092050 con 0x7f8c50140950 2024-04-26T22:03:56.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.983+0000 7f8c54e00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8c3006c920 0x7f8c3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.983+0000 7f8c4fe00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7f8c30076330 0x7f8c300787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.984+0000 7f8c54e00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8c3006c920 0x7f8c3006ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c44032000 tx=0x7f8c44009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.984+0000 7f8c4fe00640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7f8c30076330 0x7f8c300787d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:56.986+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== osd.6 v2:172.21.15.112:6800/3731383077 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c48016e70 con 0x7f8c30076330 2024-04-26T22:03:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.003+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 --> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8c5006ea50 con 0x7f8c30076330 2024-04-26T22:03:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.004+0000 7f8c4cc00640 1 -- 172.21.15.5:0/1299231547 <== osd.6 v2:172.21.15.112:6800/3731383077 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8c5006ea50 con 0x7f8c30076330 2024-04-26T22:03:57.003 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:57.003 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:57.004 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.004+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7f8c30076330 msgr2=0x7f8c300787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.004+0000 7f8c57800640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6800/3731383077,v1:172.21.15.112:6801/3731383077] conn(0x7f8c30076330 0x7f8c300787d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8c3006c920 msgr2=0x7f8c3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f8c3006c920 0x7f8c3006ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c44032000 tx=0x7f8c44009030 comp rx=0 tx=0).stop 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c50140950 msgr2=0x7f8c501dea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 --2- 172.21.15.5:0/1299231547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c50140950 0x7f8c501dea70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8c5006f5c0 tx=0x7f8c4800d9d0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c55800640 1 -- 172.21.15.5:0/1299231547 reap_dead start 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 shutdown_connections 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 >> 172.21.15.5:0/1299231547 conn(0x7f8c50068480 msgr2=0x7f8c50146600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 shutdown_connections 2024-04-26T22:03:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.005+0000 7f8c57800640 1 -- 172.21.15.5:0/1299231547 wait complete. 2024-04-26T22:03:57.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T22:03:57.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.224+0000 7f0edcc00640 1 Processor -- start 2024-04-26T22:03:57.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.224+0000 7f0edcc00640 1 -- start start 2024-04-26T22:03:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.225+0000 7f0edcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ed8142a20 0x7f0ed80b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.225+0000 7f0edcc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0ed8148600 0x7f0ed8148a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.225+0000 7f0edcc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed80bb260 con 0x7f0ed80bae80 2024-04-26T22:03:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.225+0000 7f0edcc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed80b6270 con 0x7f0ed8142a20 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.225+0000 7f0edcc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed80b6550 con 0x7f0ed8148600 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ed8142a20 0x7f0ed80b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ed8142a20 0x7f0ed80b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54036/0 (socket says 172.21.15.5:54036) 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed6a00640 1 -- 172.21.15.5:0/4111097383 learned_addr learned my addr 172.21.15.5:0/4111097383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed7e00640 1 --2- 172.21.15.5:0/4111097383 >> v2:172.21.15.112:3300/0 conn(0x7f0ed8148600 0x7f0ed8148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed6a00640 1 -- 172.21.15.5:0/4111097383 >> v2:172.21.15.112:3300/0 conn(0x7f0ed8148600 msgr2=0x7f0ed8148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed6a00640 1 --2- 172.21.15.5:0/4111097383 >> v2:172.21.15.112:3300/0 conn(0x7f0ed8148600 0x7f0ed8148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed6a00640 1 -- 172.21.15.5:0/4111097383 >> v1:172.21.15.112:6789/0 conn(0x7f0ed80bae80 legacy=0x7f0ed8142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.226+0000 7f0ed6a00640 1 -- 172.21.15.5:0/4111097383 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed80b6830 con 0x7f0ed8142a20 2024-04-26T22:03:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.227+0000 7f0ed6a00640 1 --2- 172.21.15.5:0/4111097383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8142a20 0x7f0ed80b57d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80b9e00 tx=0x7f0ec002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d855ca476f527d90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.228+0000 7f0ed6000640 1 -- 172.21.15.5:0/4111097383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0037070 con 0x7f0ed8142a20 2024-04-26T22:03:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.228+0000 7f0ed6000640 1 -- 172.21.15.5:0/4111097383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec0032440 con 0x7f0ed8142a20 2024-04-26T22:03:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.228+0000 7f0ed6000640 1 -- 172.21.15.5:0/4111097383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0032810 con 0x7f0ed8142a20 2024-04-26T22:03:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.228+0000 7f0edcc00640 1 -- 172.21.15.5:0/4111097383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8142a20 msgr2=0x7f0ed80b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.228+0000 7f0edcc00640 1 --2- 172.21.15.5:0/4111097383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8142a20 0x7f0ed80b57d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80b9e00 tx=0x7f0ec002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.229+0000 7f0edcc00640 1 -- 172.21.15.5:0/4111097383 shutdown_connections 2024-04-26T22:03:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.229+0000 7f0edcc00640 1 --2- 172.21.15.5:0/4111097383 >> v2:172.21.15.112:3300/0 conn(0x7f0ed8148600 0x7f0ed8148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.229+0000 7f0edcc00640 1 --2- 172.21.15.5:0/4111097383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8142a20 0x7f0ed80b57d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.229+0000 7f0edcc00640 1 -- 172.21.15.5:0/4111097383 >> 172.21.15.5:0/4111097383 conn(0x7f0ed80684b0 msgr2=0x7f0ed80688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.229+0000 7f0edcc00640 1 -- 172.21.15.5:0/4111097383 shutdown_connections 2024-04-26T22:03:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.229+0000 7f0edcc00640 1 -- 172.21.15.5:0/4111097383 wait complete. 2024-04-26T22:03:57.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.231+0000 7f0edcc00640 1 Processor -- start 2024-04-26T22:03:57.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.231+0000 7f0edcc00640 1 -- start start 2024-04-26T22:03:57.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.232+0000 7f0edcc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ed80bae80 0x7f0ed8149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.232+0000 7f0edcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8148600 0x7f0ed80bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.232+0000 7f0edcc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ed813e8d0 0x7f0ed8136e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.232+0000 7f0edcc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed80ba310 con 0x7f0ed8148600 2024-04-26T22:03:57.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.232+0000 7f0edcc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed80ba190 con 0x7f0ed813e8d0 2024-04-26T22:03:57.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.232+0000 7f0edcc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed8152e10 con 0x7f0ed80bae80 2024-04-26T22:03:57.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8148600 0x7f0ed80bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed7400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ed80bae80 0x7f0ed8149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8148600 0x7f0ed80bbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54044/0 (socket says 172.21.15.5:54044) 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 -- 172.21.15.5:0/3745078162 learned_addr learned my addr 172.21.15.5:0/3745078162 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed7e00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ed813e8d0 0x7f0ed8136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 -- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ed80bae80 msgr2=0x7f0ed8149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ed80bae80 0x7f0ed8149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 -- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ed813e8d0 msgr2=0x7f0ed8136e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ed813e8d0 0x7f0ed8136e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 -- 172.21.15.5:0/3745078162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed80beb10 con 0x7f0ed8148600 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed7400640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ed80bae80 0x7f0ed8149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.233+0000 7f0ed6a00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8148600 0x7f0ed80bbc00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00090b0 tx=0x7f0ec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.234+0000 7f0ecf400640 1 -- 172.21.15.5:0/3745078162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0037040 con 0x7f0ed8148600 2024-04-26T22:03:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.234+0000 7f0ecf400640 1 -- 172.21.15.5:0/3745078162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec0004230 con 0x7f0ed8148600 2024-04-26T22:03:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.234+0000 7f0ecf400640 1 -- 172.21.15.5:0/3745078162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0003610 con 0x7f0ed8148600 2024-04-26T22:03:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.234+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed80bdcf0 con 0x7f0ed8148600 2024-04-26T22:03:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.234+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed80bda10 con 0x7f0ed8148600 2024-04-26T22:03:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.235+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed8075db0 con 0x7f0ed8148600 2024-04-26T22:03:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.236+0000 7f0ecf400640 1 -- 172.21.15.5:0/3745078162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ec00037b0 con 0x7f0ed8148600 2024-04-26T22:03:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.237+0000 7f0ecf400640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0eb406c920 0x7f0eb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.237+0000 7f0ecf400640 1 -- 172.21.15.5:0/3745078162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0ec00acc40 con 0x7f0ed8148600 2024-04-26T22:03:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.238+0000 7f0ed7400640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0eb406c920 0x7f0eb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.239+0000 7f0ed7400640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0eb406c920 0x7f0eb406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8003eb0 tx=0x7f0ec8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.242+0000 7f0ecf400640 1 -- 172.21.15.5:0/3745078162 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0ec007ac60 con 0x7f0ed8148600 2024-04-26T22:03:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.447+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f0ed8148d30 con 0x7f0eb406c920 2024-04-26T22:03:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.448+0000 7f0ecf400640 1 -- 172.21.15.5:0/3745078162 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0ed8148d30 con 0x7f0eb406c920 2024-04-26T22:03:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T22:03:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.450+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0eb406c920 msgr2=0x7f0eb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.450+0000 7f0edcc00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0eb406c920 0x7f0eb406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8003eb0 tx=0x7f0ec8009040 comp rx=0 tx=0).stop 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.450+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8148600 msgr2=0x7f0ed80bbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.450+0000 7f0edcc00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8148600 0x7f0ed80bbc00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00090b0 tx=0x7f0ec00046c0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 shutdown_connections 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ed813e8d0 0x7f0ed8136e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0eb406c920 0x7f0eb406ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ed8148600 0x7f0ed80bbc00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 --2- 172.21.15.5:0/3745078162 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0ed80bae80 0x7f0ed8149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 >> 172.21.15.5:0/3745078162 conn(0x7f0ed80684b0 msgr2=0x7f0ed8137ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 shutdown_connections 2024-04-26T22:03:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.451+0000 7f0edcc00640 1 -- 172.21.15.5:0/3745078162 wait complete. 2024-04-26T22:03:57.469 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T22:03:57.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:03:57.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.689+0000 7f0868e00640 1 Processor -- start 2024-04-26T22:03:57.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.689+0000 7f0868e00640 1 -- start start 2024-04-26T22:03:57.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.690+0000 7f0868e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08640b46d0 0x7f08640738b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.690+0000 7f0868e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0864071de0 con 0x7f086406cc80 2024-04-26T22:03:57.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.690+0000 7f0868e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086406d060 con 0x7f0864073df0 2024-04-26T22:03:57.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.690+0000 7f0868e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0864140e60 con 0x7f08640b46d0 2024-04-26T22:03:57.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.691+0000 7f0861e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f086406cc80 0x7f0864070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45272/0 (socket says 172.21.15.5:45272) 2024-04-26T22:03:57.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.691+0000 7f0861e00640 1 -- 172.21.15.5:0/2532649255 learned_addr learned my addr 172.21.15.5:0/2532649255 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:57.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.691+0000 7f0861400640 1 --2- 172.21.15.5:0/2532649255 >> v2:172.21.15.112:3300/0 conn(0x7f08640b46d0 0x7f08640738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.691+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975135566 0 0) 0x7f0864071de0 con 0x7f086406cc80 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.691+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0848003520 con 0x7f086406cc80 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 695035489 0 0) 0x7f0848003520 con 0x7f086406cc80 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 >> v2:172.21.15.112:3300/0 conn(0x7f08640b46d0 msgr2=0x7f08640738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 --2- 172.21.15.5:0/2532649255 >> v2:172.21.15.112:3300/0 conn(0x7f08640b46d0 0x7f08640738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 >> v1:172.21.15.112:6789/0 conn(0x7f0864073df0 legacy=0x7f0864150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08641466a0 con 0x7f086406cc80 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7f08540019f0 con 0x7f086406cc80 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 >> v1:172.21.15.5:6789/0 conn(0x7f086406cc80 legacy=0x7f0864070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0848003a00 0x7f0848003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0848004800 0x7f0848004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08480052e0 0x7f084800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0864140e60 con 0x7f08480052e0 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f084800c1e0 con 0x7f0848003a00 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f084800c3e0 con 0x7f0848004800 2024-04-26T22:03:57.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.692+0000 7f0862800640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08480052e0 0x7f084800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.693+0000 7f0861e00640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0848003a00 0x7f0848003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.693+0000 7f0861400640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0848004800 0x7f0848004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.693+0000 7f0862800640 1 -- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0848004800 msgr2=0x7f0848004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.693+0000 7f0862800640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0848004800 0x7f0848004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.693+0000 7f0862800640 1 -- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0848003a00 msgr2=0x7f0848003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.693+0000 7f0862800640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0848003a00 0x7f0848003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.693+0000 7f0862800640 1 -- 172.21.15.5:0/2532649255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0848003520 con 0x7f08480052e0 2024-04-26T22:03:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.694+0000 7f0862800640 1 -- 172.21.15.5:0/2532649255 reap_dead start 2024-04-26T22:03:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.694+0000 7f0862800640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08480052e0 0x7f084800b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f085c001750 tx=0x7f0848005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a712a94cd814d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.694+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c001370 con 0x7f08480052e0 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.694+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c005310 con 0x7f08480052e0 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.694+0000 7f0860a00640 1 -- 172.21.15.5:0/2532649255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c02abe0 con 0x7f08480052e0 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.695+0000 7f0868e00640 1 -- 172.21.15.5:0/2532649255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08480052e0 msgr2=0x7f084800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.695+0000 7f0868e00640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08480052e0 0x7f084800b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f085c001750 tx=0x7f0848005830 comp rx=0 tx=0).stop 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.695+0000 7f0868e00640 1 -- 172.21.15.5:0/2532649255 shutdown_connections 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.695+0000 7f0868e00640 1 --2- 172.21.15.5:0/2532649255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08480052e0 0x7f084800b9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.695+0000 7f0868e00640 1 -- 172.21.15.5:0/2532649255 >> 172.21.15.5:0/2532649255 conn(0x7f08640ba330 msgr2=0x7f086406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.695+0000 7f0868e00640 1 -- 172.21.15.5:0/2532649255 shutdown_connections 2024-04-26T22:03:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.695+0000 7f0868e00640 1 -- 172.21.15.5:0/2532649255 wait complete. 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.697+0000 7f0868e00640 1 Processor -- start 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.697+0000 7f0868e00640 1 -- start start 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0868e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08480052e0 0x7f08640ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0868e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086413d0b0 0x7f08640b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0868e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08640b0110 0x7f086413ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0868e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0864146c40 con 0x7f086413d0b0 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0868e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0864072050 con 0x7f08480052e0 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0868e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0864146f20 con 0x7f08640b0110 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086413d0b0 0x7f08640b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086413d0b0 0x7f08640b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54068/0 (socket says 172.21.15.5:54068) 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 -- 172.21.15.5:0/2237782369 learned_addr learned my addr 172.21.15.5:0/2237782369 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861e00640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08480052e0 0x7f08640ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 -- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08640b0110 msgr2=0x7f086413ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08640b0110 0x7f086413ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 -- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08480052e0 msgr2=0x7f08640ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08480052e0 0x7f08640ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861400640 1 -- 172.21.15.5:0/2237782369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086413e070 con 0x7f086413d0b0 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.698+0000 7f0861e00640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08480052e0 0x7f08640ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.699+0000 7f0861400640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086413d0b0 0x7f08640b22f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f084c011570 tx=0x7f084c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.699+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c015930 con 0x7f086413d0b0 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.699+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c015ad0 con 0x7f086413d0b0 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.699+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c01d400 con 0x7f086413d0b0 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.699+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08640b1810 con 0x7f086413d0b0 2024-04-26T22:03:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.699+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086413efb0 con 0x7f086413d0b0 2024-04-26T22:03:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.701+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0864075db0 con 0x7f086413d0b0 2024-04-26T22:03:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.702+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f084c01d5a0 con 0x7f086413d0b0 2024-04-26T22:03:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.703+0000 7f085a000640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f084006c920 0x7f084006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.703+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f084c08c820 con 0x7f086413d0b0 2024-04-26T22:03:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.703+0000 7f085a000640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7f0840076330 0x7f08400787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.703+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 --> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f084c008eb0 con 0x7f0840076330 2024-04-26T22:03:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.703+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f084c093050 con 0x7f086413d0b0 2024-04-26T22:03:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.704+0000 7f0861e00640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f084006c920 0x7f084006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.704+0000 7f0862800640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7f0840076330 0x7f08400787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.705+0000 7f0862800640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7f0840076330 0x7f08400787d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.705+0000 7f0861e00640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f084006c920 0x7f084006ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0854001460 tx=0x7f08540012f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.707+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== osd.7 v2:172.21.15.112:6816/403622825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f084c008eb0 con 0x7f0840076330 2024-04-26T22:03:57.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.722+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 --> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f08640732b0 con 0x7f0840076330 2024-04-26T22:03:57.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.723+0000 7f085a000640 1 -- 172.21.15.5:0/2237782369 <== osd.7 v2:172.21.15.112:6816/403622825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f08640732b0 con 0x7f0840076330 2024-04-26T22:03:57.723 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-26T22:03:57.724 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:03:57.724 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7f0840076330 msgr2=0x7f08400787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6816/403622825,v1:172.21.15.112:6817/403622825] conn(0x7f0840076330 0x7f08400787d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f084006c920 msgr2=0x7f084006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f084006c920 0x7f084006ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0854001460 tx=0x7f08540012f0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086413d0b0 msgr2=0x7f08640b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 --2- 172.21.15.5:0/2237782369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f086413d0b0 0x7f08640b22f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f084c011570 tx=0x7f084c011a30 comp rx=0 tx=0).stop 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0862800640 1 -- 172.21.15.5:0/2237782369 reap_dead start 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 shutdown_connections 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.724+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 >> 172.21.15.5:0/2237782369 conn(0x7f08640ba330 msgr2=0x7f0864145a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.725+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 shutdown_connections 2024-04-26T22:03:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.725+0000 7f0868e00640 1 -- 172.21.15.5:0/2237782369 wait complete. 2024-04-26T22:03:57.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T22:03:57.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.948+0000 7f2bee000640 1 Processor -- start 2024-04-26T22:03:57.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.948+0000 7f2bee000640 1 -- start start 2024-04-26T22:03:57.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.950+0000 7f2bee000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2be8072c80 0x7f2be814be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.950+0000 7f2bee000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be80b6ec0 con 0x7f2be80b6ae0 2024-04-26T22:03:57.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.950+0000 7f2bee000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be8073130 con 0x7f2be806ef40 2024-04-26T22:03:57.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.950+0000 7f2bee000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2be8073410 con 0x7f2be8072c80 2024-04-26T22:03:57.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.950+0000 7f2becc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2be80b6ae0 0x7f2be8142470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45280/0 (socket says 172.21.15.5:45280) 2024-04-26T22:03:57.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.950+0000 7f2becc00640 1 -- 172.21.15.5:0/2007273145 learned_addr learned my addr 172.21.15.5:0/2007273145 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:57.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.950+0000 7f2be7e00640 1 --2- 172.21.15.5:0/2007273145 >> v2:172.21.15.5:3300/0 conn(0x7f2be8072c80 0x7f2be814be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.951+0000 7f2be7e00640 1 -- 172.21.15.5:0/2007273145 >> v1:172.21.15.112:6789/0 conn(0x7f2be806ef40 legacy=0x7f2be8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.951+0000 7f2be7e00640 1 -- 172.21.15.5:0/2007273145 >> v1:172.21.15.5:6789/0 conn(0x7f2be80b6ae0 legacy=0x7f2be8142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.951+0000 7f2be7e00640 1 -- 172.21.15.5:0/2007273145 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be8142b80 con 0x7f2be8072c80 2024-04-26T22:03:57.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.951+0000 7f2be7400640 1 -- 172.21.15.5:0/2007273145 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582884259 0 0) 0x7f2be80b6ec0 con 0x7f2be80b6ae0 2024-04-26T22:03:57.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.952+0000 7f2be7e00640 1 --2- 172.21.15.5:0/2007273145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be8072c80 0x7f2be814be90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40097a0 tx=0x7f2bd402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c699948dff8618d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.952+0000 7f2be7400640 1 -- 172.21.15.5:0/2007273145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4037070 con 0x7f2be8072c80 2024-04-26T22:03:57.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.952+0000 7f2be7400640 1 -- 172.21.15.5:0/2007273145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd402ae50 con 0x7f2be8072c80 2024-04-26T22:03:57.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.952+0000 7f2be7400640 1 -- 172.21.15.5:0/2007273145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4032660 con 0x7f2be8072c80 2024-04-26T22:03:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.953+0000 7f2bee000640 1 -- 172.21.15.5:0/2007273145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be8072c80 msgr2=0x7f2be814be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.953+0000 7f2bee000640 1 --2- 172.21.15.5:0/2007273145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be8072c80 0x7f2be814be90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40097a0 tx=0x7f2bd402a140 comp rx=0 tx=0).stop 2024-04-26T22:03:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.953+0000 7f2bee000640 1 -- 172.21.15.5:0/2007273145 shutdown_connections 2024-04-26T22:03:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.953+0000 7f2bee000640 1 --2- 172.21.15.5:0/2007273145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be8072c80 0x7f2be814be90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.953+0000 7f2bee000640 1 -- 172.21.15.5:0/2007273145 >> 172.21.15.5:0/2007273145 conn(0x7f2be806d410 msgr2=0x7f2be806d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.953+0000 7f2bee000640 1 -- 172.21.15.5:0/2007273145 shutdown_connections 2024-04-26T22:03:57.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.953+0000 7f2bee000640 1 -- 172.21.15.5:0/2007273145 wait complete. 2024-04-26T22:03:57.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.955+0000 7f2bee000640 1 Processor -- start 2024-04-26T22:03:57.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.955+0000 7f2bee000640 1 -- start start 2024-04-26T22:03:57.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.956+0000 7f2bee000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be806ef40 0x7f2be8145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.956+0000 7f2bee000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2be8072c80 0x7f2be8144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.956+0000 7f2bee000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be80b6ae0 0x7f2be8140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.956+0000 7f2bee000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2be814c3d0 con 0x7f2be80b6ae0 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.956+0000 7f2bee000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2be80b7460 con 0x7f2be806ef40 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.956+0000 7f2bee000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2be814c550 con 0x7f2be8072c80 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be80b6ae0 0x7f2be8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be80b6ae0 0x7f2be8140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54086/0 (socket says 172.21.15.5:54086) 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 -- 172.21.15.5:0/1943707704 learned_addr learned my addr 172.21.15.5:0/1943707704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2becc00640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be806ef40 0x7f2be8145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2be7e00640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2be8072c80 0x7f2be8144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 -- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2be8072c80 msgr2=0x7f2be8144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2be8072c80 0x7f2be8144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 -- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be806ef40 msgr2=0x7f2be8145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be806ef40 0x7f2be8145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.957+0000 7f2bed600640 1 -- 172.21.15.5:0/1943707704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be8145e80 con 0x7f2be80b6ae0 2024-04-26T22:03:57.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.958+0000 7f2bed600640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be80b6ae0 0x7f2be8140310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c700 tx=0x7f2be000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.958+0000 7f2be4c00640 1 -- 172.21.15.5:0/1943707704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0016020 con 0x7f2be80b6ae0 2024-04-26T22:03:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.958+0000 7f2be4c00640 1 -- 172.21.15.5:0/1943707704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be000aa50 con 0x7f2be80b6ae0 2024-04-26T22:03:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.958+0000 7f2be4c00640 1 -- 172.21.15.5:0/1943707704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be000ae40 con 0x7f2be80b6ae0 2024-04-26T22:03:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.958+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be813aa60 con 0x7f2be80b6ae0 2024-04-26T22:03:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.958+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be813fdf0 con 0x7f2be80b6ae0 2024-04-26T22:03:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.959+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be8075db0 con 0x7f2be80b6ae0 2024-04-26T22:03:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.961+0000 7f2be4c00640 1 -- 172.21.15.5:0/1943707704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2be0019020 con 0x7f2be80b6ae0 2024-04-26T22:03:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.961+0000 7f2be4c00640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2bc806c8f0 0x7f2bc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.962+0000 7f2be4c00640 1 -- 172.21.15.5:0/1943707704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2be008bee0 con 0x7f2be80b6ae0 2024-04-26T22:03:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.962+0000 7f2becc00640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2bc806c8f0 0x7f2bc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.963+0000 7f2becc00640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2bc806c8f0 0x7f2bc806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc000f60 tx=0x7f2bdc007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:57.966+0000 7f2be4c00640 1 -- 172.21.15.5:0/1943707704 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2be0020030 con 0x7f2be80b6ae0 2024-04-26T22:03:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.180+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2be813e9f0 con 0x7f2bc806c8f0 2024-04-26T22:03:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.182+0000 7f2be4c00640 1 -- 172.21.15.5:0/1943707704 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2be813e9f0 con 0x7f2bc806c8f0 2024-04-26T22:03:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T22:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2bc806c8f0 msgr2=0x7f2bc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2bc806c8f0 0x7f2bc806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc000f60 tx=0x7f2bdc007c00 comp rx=0 tx=0).stop 2024-04-26T22:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be80b6ae0 msgr2=0x7f2be8140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be80b6ae0 0x7f2be8140310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c700 tx=0x7f2be000cbc0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 shutdown_connections 2024-04-26T22:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f2bc806c8f0 0x7f2bc806edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2be80b6ae0 0x7f2be8140310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2be8072c80 0x7f2be8144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 --2- 172.21.15.5:0/1943707704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be806ef40 0x7f2be8145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 >> 172.21.15.5:0/1943707704 conn(0x7f2be806d410 msgr2=0x7f2be806e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 shutdown_connections 2024-04-26T22:03:58.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.185+0000 7f2bee000640 1 -- 172.21.15.5:0/1943707704 wait complete. 2024-04-26T22:03:58.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:03:58.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.417+0000 7f0e57e00640 1 Processor -- start 2024-04-26T22:03:58.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.417+0000 7f0e57e00640 1 -- start start 2024-04-26T22:03:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.419+0000 7f0e57e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e580b0fe0 0x7f0e58158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.419+0000 7f0e57e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e580b31d0 con 0x7f0e580b2180 2024-04-26T22:03:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.419+0000 7f0e57e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e580b2560 con 0x7f0e5814c8b0 2024-04-26T22:03:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.419+0000 7f0e57e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0e580b0920 con 0x7f0e580b0fe0 2024-04-26T22:03:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.419+0000 7f0e56a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0e580b2180 0x7f0e5814d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45282/0 (socket says 172.21.15.5:45282) 2024-04-26T22:03:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.419+0000 7f0e56a00640 1 -- 172.21.15.5:0/598186954 learned_addr learned my addr 172.21.15.5:0/598186954 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:03:58.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.419+0000 7f0e57400640 1 --2- 172.21.15.5:0/598186954 >> v2:172.21.15.5:3300/0 conn(0x7f0e580b0fe0 0x7f0e58158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.420+0000 7f0e55600640 1 -- 172.21.15.5:0/598186954 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227229860 0 0) 0x7f0e580b31d0 con 0x7f0e580b2180 2024-04-26T22:03:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.420+0000 7f0e55600640 1 -- 172.21.15.5:0/598186954 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e3c003520 con 0x7f0e580b2180 2024-04-26T22:03:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.420+0000 7f0e57400640 1 -- 172.21.15.5:0/598186954 >> v1:172.21.15.112:6789/0 conn(0x7f0e5814c8b0 legacy=0x7f0e58155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.420+0000 7f0e57400640 1 -- 172.21.15.5:0/598186954 >> v1:172.21.15.5:6789/0 conn(0x7f0e580b2180 legacy=0x7f0e5814d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.420+0000 7f0e57400640 1 -- 172.21.15.5:0/598186954 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e580b3440 con 0x7f0e580b0fe0 2024-04-26T22:03:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.421+0000 7f0e57400640 1 --2- 172.21.15.5:0/598186954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b0fe0 0x7f0e58158870 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b158b18da6a6ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.421+0000 7f0e55600640 1 -- 172.21.15.5:0/598186954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50031600 con 0x7f0e580b0fe0 2024-04-26T22:03:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.421+0000 7f0e55600640 1 -- 172.21.15.5:0/598186954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e500317a0 con 0x7f0e580b0fe0 2024-04-26T22:03:58.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.421+0000 7f0e55600640 1 -- 172.21.15.5:0/598186954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50031b70 con 0x7f0e580b0fe0 2024-04-26T22:03:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.422+0000 7f0e57e00640 1 -- 172.21.15.5:0/598186954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b0fe0 msgr2=0x7f0e58158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.422+0000 7f0e57e00640 1 --2- 172.21.15.5:0/598186954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b0fe0 0x7f0e58158870 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5002a610 comp rx=0 tx=0).stop 2024-04-26T22:03:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.422+0000 7f0e57e00640 1 -- 172.21.15.5:0/598186954 shutdown_connections 2024-04-26T22:03:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.422+0000 7f0e57e00640 1 --2- 172.21.15.5:0/598186954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b0fe0 0x7f0e58158870 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.422+0000 7f0e57e00640 1 -- 172.21.15.5:0/598186954 >> 172.21.15.5:0/598186954 conn(0x7f0e5806c300 msgr2=0x7f0e5806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.422+0000 7f0e57e00640 1 -- 172.21.15.5:0/598186954 shutdown_connections 2024-04-26T22:03:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.422+0000 7f0e57e00640 1 -- 172.21.15.5:0/598186954 wait complete. 2024-04-26T22:03:58.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.424+0000 7f0e57e00640 1 Processor -- start 2024-04-26T22:03:58.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.424+0000 7f0e57e00640 1 -- start start 2024-04-26T22:03:58.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.425+0000 7f0e57e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e580b0fe0 0x7f0e58149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.425+0000 7f0e57e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b2180 0x7f0e58148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.425+0000 7f0e57e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e5814c8b0 0x7f0e58148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.425+0000 7f0e57e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0e580b16f0 con 0x7f0e580b2180 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.425+0000 7f0e57e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5806ebc0 con 0x7f0e580b0fe0 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.425+0000 7f0e57e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5814d740 con 0x7f0e5814c8b0 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b2180 0x7f0e58148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b2180 0x7f0e58148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54090/0 (socket says 172.21.15.5:54090) 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 -- 172.21.15.5:0/3018960677 learned_addr learned my addr 172.21.15.5:0/3018960677 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56a00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e580b0fe0 0x7f0e58149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 -- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e5814c8b0 msgr2=0x7f0e58148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e5814c8b0 0x7f0e58148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 -- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e580b0fe0 msgr2=0x7f0e58149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e580b0fe0 0x7f0e58149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 -- 172.21.15.5:0/3018960677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5814a180 con 0x7f0e580b2180 2024-04-26T22:03:58.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.426+0000 7f0e56000640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b2180 0x7f0e58148f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b3c0 tx=0x7f0e4000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.427+0000 7f0e4ea00640 1 -- 172.21.15.5:0/3018960677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011830 con 0x7f0e580b2180 2024-04-26T22:03:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.427+0000 7f0e4ea00640 1 -- 172.21.15.5:0/3018960677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e40016070 con 0x7f0e580b2180 2024-04-26T22:03:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.427+0000 7f0e4ea00640 1 -- 172.21.15.5:0/3018960677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011c50 con 0x7f0e580b2180 2024-04-26T22:03:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.427+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e581d2bd0 con 0x7f0e580b2180 2024-04-26T22:03:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.427+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e58149440 con 0x7f0e580b2180 2024-04-26T22:03:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.428+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e58075db0 con 0x7f0e580b2180 2024-04-26T22:03:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.429+0000 7f0e4ea00640 1 -- 172.21.15.5:0/3018960677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e4001b460 con 0x7f0e580b2180 2024-04-26T22:03:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.430+0000 7f0e4ea00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0e3406c8f0 0x7f0e3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.430+0000 7f0e4ea00640 1 -- 172.21.15.5:0/3018960677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0e4008b9e0 con 0x7f0e580b2180 2024-04-26T22:03:58.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.431+0000 7f0e56a00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0e3406c8f0 0x7f0e3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.432+0000 7f0e56a00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0e3406c8f0 0x7f0e3406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e48000f60 tx=0x7f0e48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.435+0000 7f0e4ea00640 1 -- 172.21.15.5:0/3018960677 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0e40020020 con 0x7f0e580b2180 2024-04-26T22:03:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.637+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e580b9350 con 0x7f0e3406c8f0 2024-04-26T22:03:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.663+0000 7f0e4ea00640 1 -- 172.21.15.5:0/3018960677 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333186 (secure 0 0 0) 0x7f0e580b9350 con 0x7f0e3406c8f0 2024-04-26T22:03:58.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:03:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0e3406c8f0 msgr2=0x7f0e3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0e3406c8f0 0x7f0e3406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e48000f60 tx=0x7f0e48009040 comp rx=0 tx=0).stop 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b2180 msgr2=0x7f0e58148f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b2180 0x7f0e58148f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b3c0 tx=0x7f0e4000b880 comp rx=0 tx=0).stop 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 shutdown_connections 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0e5814c8b0 0x7f0e58148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f0e3406c8f0 0x7f0e3406edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e580b2180 0x7f0e58148f00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 --2- 172.21.15.5:0/3018960677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e580b0fe0 0x7f0e58149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.670+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 >> 172.21.15.5:0/3018960677 conn(0x7f0e5806c300 msgr2=0x7f0e581d8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.671+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 shutdown_connections 2024-04-26T22:03:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:03:58.671+0000 7f0e57e00640 1 -- 172.21.15.5:0/3018960677 wait complete. 2024-04-26T22:03:58.693 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":826,"stamp":"2024-04-26T22:03:58.101558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240755740,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2795,"num_read_kb":5345,"num_write":112477,"num_write_kb":2515076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155959,"ondisk_log_size":155959,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2512272,"kb_used_data":472464,"kb_used_omap":12,"kb_used_meta":2039731,"kb_avail":752462448,"statfs":{"total":773094113280,"available":770521546752,"internally_reserved":0,"allocated":483803136,"data_stored":482426304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2088685108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4792,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005596"},"pg_stats":[{"pgid":"2.1f","version":"26'1240","reported_seq":1279,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750849+0000","last_change":"2024-04-26T21:37:16.435445+0000","last_active":"2024-04-26T22:03:37.750849+0000","last_peered":"2024-04-26T22:03:37.750849+0000","last_clean":"2024-04-26T22:03:37.750849+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T22:03:37.750849+0000","last_undegraded":"2024-04-26T22:03:37.750849+0000","last_fullsized":"2024-04-26T22:03:37.750849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'475","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032915+0000","last_change":"2024-04-26T21:37:17.446321+0000","last_active":"2024-04-26T22:03:43.032915+0000","last_peered":"2024-04-26T22:03:43.032915+0000","last_clean":"2024-04-26T22:03:43.032915+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T22:03:43.032915+0000","last_undegraded":"2024-04-26T22:03:43.032915+0000","last_fullsized":"2024-04-26T22:03:43.032915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'1944","reported_seq":1972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.226697+0000","last_change":"2024-04-26T21:37:21.488722+0000","last_active":"2024-04-26T22:03:35.226697+0000","last_peered":"2024-04-26T22:03:35.226697+0000","last_clean":"2024-04-26T22:03:35.226697+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T22:03:35.226697+0000","last_undegraded":"2024-04-26T22:03:35.226697+0000","last_fullsized":"2024-04-26T22:03:35.226697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1944,"log_dups_size":0,"ondisk_log_size":1944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":38072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3188","reported_seq":3227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746607+0000","last_change":"2024-04-26T21:37:16.425864+0000","last_active":"2024-04-26T22:03:37.746607+0000","last_peered":"2024-04-26T22:03:37.746607+0000","last_clean":"2024-04-26T22:03:37.746607+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T22:03:37.746607+0000","last_undegraded":"2024-04-26T22:03:37.746607+0000","last_fullsized":"2024-04-26T22:03:37.746607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3188,"log_dups_size":0,"ondisk_log_size":3188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3196,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'472","reported_seq":509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.017836+0000","last_change":"2024-04-26T21:37:17.456073+0000","last_active":"2024-04-26T22:03:43.017836+0000","last_peered":"2024-04-26T22:03:43.017836+0000","last_clean":"2024-04-26T22:03:43.017836+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T22:03:43.017836+0000","last_undegraded":"2024-04-26T22:03:43.017836+0000","last_fullsized":"2024-04-26T22:03:43.017836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2092","reported_seq":2120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194904+0000","last_change":"2024-04-26T21:37:21.498344+0000","last_active":"2024-04-26T22:03:35.194904+0000","last_peered":"2024-04-26T22:03:35.194904+0000","last_clean":"2024-04-26T22:03:35.194904+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T22:03:35.194904+0000","last_undegraded":"2024-04-26T22:03:35.194904+0000","last_fullsized":"2024-04-26T22:03:35.194904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":42136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3681","reported_seq":3717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.754029+0000","last_change":"2024-04-26T21:37:16.448953+0000","last_active":"2024-04-26T22:03:36.754029+0000","last_peered":"2024-04-26T22:03:36.754029+0000","last_clean":"2024-04-26T22:03:36.754029+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T22:03:36.754029+0000","last_undegraded":"2024-04-26T22:03:36.754029+0000","last_fullsized":"2024-04-26T22:03:36.754029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:05.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3687,"num_write_kb":30415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'531","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.040634+0000","last_change":"2024-04-26T21:37:17.444712+0000","last_active":"2024-04-26T22:03:43.040634+0000","last_peered":"2024-04-26T22:03:43.040634+0000","last_clean":"2024-04-26T22:03:43.040634+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T22:03:43.040634+0000","last_undegraded":"2024-04-26T22:03:43.040634+0000","last_fullsized":"2024-04-26T22:03:43.040634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:16.313456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'2113","reported_seq":2148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.137495+0000","last_change":"2024-04-26T21:37:58.756041+0000","last_active":"2024-04-26T22:03:35.137495+0000","last_peered":"2024-04-26T22:03:35.137495+0000","last_clean":"2024-04-26T22:03:35.137495+0000","last_became_active":"2024-04-26T21:37:58.754696+0000","last_became_peered":"2024-04-26T21:37:58.754696+0000","last_unstale":"2024-04-26T22:03:35.137495+0000","last_undegraded":"2024-04-26T22:03:35.137495+0000","last_fullsized":"2024-04-26T22:03:35.137495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:14.032751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1612,"num_write_kb":85113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'411","reported_seq":447,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746921+0000","last_change":"2024-04-26T21:37:16.444020+0000","last_active":"2024-04-26T22:03:36.746921+0000","last_peered":"2024-04-26T22:03:36.746921+0000","last_clean":"2024-04-26T22:03:36.746921+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T22:03:36.746921+0000","last_undegraded":"2024-04-26T22:03:36.746921+0000","last_fullsized":"2024-04-26T22:03:36.746921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039133+0000","last_change":"2024-04-26T21:37:17.449097+0000","last_active":"2024-04-26T22:03:43.039133+0000","last_peered":"2024-04-26T22:03:43.039133+0000","last_clean":"2024-04-26T22:03:43.039133+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T22:03:43.039133+0000","last_undegraded":"2024-04-26T22:03:43.039133+0000","last_fullsized":"2024-04-26T22:03:43.039133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'2117","reported_seq":2145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233562+0000","last_change":"2024-04-26T21:37:21.500731+0000","last_active":"2024-04-26T22:03:35.233562+0000","last_peered":"2024-04-26T22:03:35.233562+0000","last_clean":"2024-04-26T22:03:35.233562+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T22:03:35.233562+0000","last_undegraded":"2024-04-26T22:03:35.233562+0000","last_fullsized":"2024-04-26T22:03:35.233562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2117,"log_dups_size":0,"ondisk_log_size":2117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:04.611319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1631,"num_write_kb":60261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'502","reported_seq":538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043741+0000","last_change":"2024-04-26T21:37:17.457482+0000","last_active":"2024-04-26T22:03:43.043741+0000","last_peered":"2024-04-26T22:03:43.043741+0000","last_clean":"2024-04-26T22:03:43.043741+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T22:03:43.043741+0000","last_undegraded":"2024-04-26T22:03:43.043741+0000","last_fullsized":"2024-04-26T22:03:43.043741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:44.673344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'2421","reported_seq":2458,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750510+0000","last_change":"2024-04-26T21:37:16.442159+0000","last_active":"2024-04-26T22:03:37.750510+0000","last_peered":"2024-04-26T22:03:37.750510+0000","last_clean":"2024-04-26T22:03:37.750510+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T22:03:37.750510+0000","last_undegraded":"2024-04-26T22:03:37.750510+0000","last_fullsized":"2024-04-26T22:03:37.750510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2421,"log_dups_size":0,"ondisk_log_size":2421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:26.259770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":21667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'2164","reported_seq":2193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.113767+0000","last_change":"2024-04-26T21:37:21.492057+0000","last_active":"2024-04-26T22:03:35.113767+0000","last_peered":"2024-04-26T22:03:35.113767+0000","last_clean":"2024-04-26T22:03:35.113767+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T22:03:35.113767+0000","last_undegraded":"2024-04-26T22:03:35.113767+0000","last_fullsized":"2024-04-26T22:03:35.113767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2164,"log_dups_size":0,"ondisk_log_size":2164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:40.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1702,"num_write_kb":82391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'487","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035776+0000","last_change":"2024-04-26T21:37:17.450610+0000","last_active":"2024-04-26T22:03:43.035776+0000","last_peered":"2024-04-26T22:03:43.035776+0000","last_clean":"2024-04-26T22:03:43.035776+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T22:03:43.035776+0000","last_undegraded":"2024-04-26T22:03:43.035776+0000","last_fullsized":"2024-04-26T22:03:43.035776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:05.418157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'2546","reported_seq":2585,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.745442+0000","last_change":"2024-04-26T21:37:16.434686+0000","last_active":"2024-04-26T22:03:37.745442+0000","last_peered":"2024-04-26T22:03:37.745442+0000","last_clean":"2024-04-26T22:03:37.745442+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T22:03:37.745442+0000","last_undegraded":"2024-04-26T22:03:37.745442+0000","last_fullsized":"2024-04-26T22:03:37.745442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2546,"log_dups_size":0,"ondisk_log_size":2546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2556,"num_write_kb":21644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'2346","reported_seq":2375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.178720+0000","last_change":"2024-04-26T21:37:21.509284+0000","last_active":"2024-04-26T22:03:35.178720+0000","last_peered":"2024-04-26T22:03:35.178720+0000","last_clean":"2024-04-26T22:03:35.178720+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T22:03:35.178720+0000","last_undegraded":"2024-04-26T22:03:35.178720+0000","last_fullsized":"2024-04-26T22:03:35.178720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2346,"log_dups_size":0,"ondisk_log_size":2346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1850,"num_write_kb":43022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'518","reported_seq":554,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032499+0000","last_change":"2024-04-26T21:37:17.448726+0000","last_active":"2024-04-26T22:03:43.032499+0000","last_peered":"2024-04-26T22:03:43.032499+0000","last_clean":"2024-04-26T22:03:43.032499+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T22:03:43.032499+0000","last_undegraded":"2024-04-26T22:03:43.032499+0000","last_fullsized":"2024-04-26T22:03:43.032499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'925","reported_seq":964,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.732341+0000","last_change":"2024-04-26T21:37:16.436829+0000","last_active":"2024-04-26T22:03:35.732341+0000","last_peered":"2024-04-26T22:03:35.732341+0000","last_clean":"2024-04-26T22:03:35.732341+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T22:03:35.732341+0000","last_undegraded":"2024-04-26T22:03:35.732341+0000","last_fullsized":"2024-04-26T22:03:35.732341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":8623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'2213","reported_seq":2243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.238054+0000","last_change":"2024-04-26T21:37:21.499474+0000","last_active":"2024-04-26T22:03:35.238054+0000","last_peered":"2024-04-26T22:03:35.238054+0000","last_clean":"2024-04-26T22:03:35.238054+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T22:03:35.238054+0000","last_undegraded":"2024-04-26T22:03:35.238054+0000","last_fullsized":"2024-04-26T22:03:35.238054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2213,"log_dups_size":0,"ondisk_log_size":2213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":80555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.201419+0000","last_change":"2024-04-26T21:37:17.440230+0000","last_active":"2024-04-26T22:03:35.201419+0000","last_peered":"2024-04-26T22:03:35.201419+0000","last_clean":"2024-04-26T22:03:35.201419+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T22:03:35.201419+0000","last_undegraded":"2024-04-26T22:03:35.201419+0000","last_fullsized":"2024-04-26T22:03:35.201419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:47.726024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'481","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.746018+0000","last_change":"2024-04-26T21:37:16.438186+0000","last_active":"2024-04-26T22:03:37.746018+0000","last_peered":"2024-04-26T22:03:37.746018+0000","last_clean":"2024-04-26T22:03:37.746018+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T22:03:37.746018+0000","last_undegraded":"2024-04-26T22:03:37.746018+0000","last_fullsized":"2024-04-26T22:03:37.746018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'1921","reported_seq":1950,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.233522+0000","last_change":"2024-04-26T21:37:21.500654+0000","last_active":"2024-04-26T22:03:35.233522+0000","last_peered":"2024-04-26T22:03:35.233522+0000","last_clean":"2024-04-26T22:03:35.233522+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T22:03:35.233522+0000","last_undegraded":"2024-04-26T22:03:35.233522+0000","last_fullsized":"2024-04-26T22:03:35.233522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:41.505462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'497","reported_seq":534,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032179+0000","last_change":"2024-04-26T21:37:17.439231+0000","last_active":"2024-04-26T22:03:43.032179+0000","last_peered":"2024-04-26T22:03:43.032179+0000","last_clean":"2024-04-26T22:03:43.032179+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T22:03:43.032179+0000","last_undegraded":"2024-04-26T22:03:43.032179+0000","last_fullsized":"2024-04-26T22:03:43.032179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'397","reported_seq":435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.753663+0000","last_change":"2024-04-26T21:37:16.445223+0000","last_active":"2024-04-26T22:03:37.753663+0000","last_peered":"2024-04-26T22:03:37.753663+0000","last_clean":"2024-04-26T22:03:37.753663+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T22:03:37.753663+0000","last_undegraded":"2024-04-26T22:03:37.753663+0000","last_fullsized":"2024-04-26T22:03:37.753663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'2230","reported_seq":2260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082241+0000","last_change":"2024-04-26T21:37:21.495036+0000","last_active":"2024-04-26T22:03:35.082241+0000","last_peered":"2024-04-26T22:03:35.082241+0000","last_clean":"2024-04-26T22:03:35.082241+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T22:03:35.082241+0000","last_undegraded":"2024-04-26T22:03:35.082241+0000","last_fullsized":"2024-04-26T22:03:35.082241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2230,"log_dups_size":0,"ondisk_log_size":2230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:08.171904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":137897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'453","reported_seq":489,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049286+0000","last_change":"2024-04-26T21:37:17.427504+0000","last_active":"2024-04-26T22:03:43.049286+0000","last_peered":"2024-04-26T22:03:43.049286+0000","last_clean":"2024-04-26T22:03:43.049286+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T22:03:43.049286+0000","last_undegraded":"2024-04-26T22:03:43.049286+0000","last_fullsized":"2024-04-26T22:03:43.049286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1575","reported_seq":1614,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:47.236489+0000","last_change":"2024-04-26T21:37:16.443568+0000","last_active":"2024-04-26T22:03:47.236489+0000","last_peered":"2024-04-26T22:03:47.236489+0000","last_clean":"2024-04-26T22:03:47.236489+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T22:03:47.236489+0000","last_undegraded":"2024-04-26T22:03:47.236489+0000","last_fullsized":"2024-04-26T22:03:47.236489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903801,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4315,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'1970","reported_seq":2001,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227988+0000","last_change":"2024-04-26T21:37:21.490826+0000","last_active":"2024-04-26T22:03:35.227988+0000","last_peered":"2024-04-26T22:03:35.227988+0000","last_clean":"2024-04-26T22:03:35.227988+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T22:03:35.227988+0000","last_undegraded":"2024-04-26T22:03:35.227988+0000","last_fullsized":"2024-04-26T22:03:35.227988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1970,"log_dups_size":0,"ondisk_log_size":1970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:02.906788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":39987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'506","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.028097+0000","last_change":"2024-04-26T21:37:17.435965+0000","last_active":"2024-04-26T22:03:43.028097+0000","last_peered":"2024-04-26T22:03:43.028097+0000","last_clean":"2024-04-26T22:03:43.028097+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T22:03:43.028097+0000","last_undegraded":"2024-04-26T22:03:43.028097+0000","last_fullsized":"2024-04-26T22:03:43.028097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2119","reported_seq":2157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748733+0000","last_change":"2024-04-26T21:37:16.445916+0000","last_active":"2024-04-26T22:03:36.748733+0000","last_peered":"2024-04-26T22:03:36.748733+0000","last_clean":"2024-04-26T22:03:36.748733+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T22:03:36.748733+0000","last_undegraded":"2024-04-26T22:03:36.748733+0000","last_fullsized":"2024-04-26T22:03:36.748733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2119,"log_dups_size":0,"ondisk_log_size":2119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2125,"num_write_kb":17294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2154","reported_seq":2185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.123385+0000","last_change":"2024-04-26T21:37:21.497495+0000","last_active":"2024-04-26T22:03:35.123385+0000","last_peered":"2024-04-26T22:03:35.123385+0000","last_clean":"2024-04-26T22:03:35.123385+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T22:03:35.123385+0000","last_undegraded":"2024-04-26T22:03:35.123385+0000","last_fullsized":"2024-04-26T22:03:35.123385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1661,"num_write_kb":51179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'504","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029821+0000","last_change":"2024-04-26T21:37:17.452628+0000","last_active":"2024-04-26T22:03:43.029821+0000","last_peered":"2024-04-26T22:03:43.029821+0000","last_clean":"2024-04-26T22:03:43.029821+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T22:03:43.029821+0000","last_undegraded":"2024-04-26T22:03:43.029821+0000","last_fullsized":"2024-04-26T22:03:43.029821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'363","reported_seq":402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.743200+0000","last_change":"2024-04-26T21:37:16.430276+0000","last_active":"2024-04-26T22:03:37.743200+0000","last_peered":"2024-04-26T22:03:37.743200+0000","last_clean":"2024-04-26T22:03:37.743200+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T22:03:37.743200+0000","last_undegraded":"2024-04-26T22:03:37.743200+0000","last_fullsized":"2024-04-26T22:03:37.743200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'2388","reported_seq":2419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.212554+0000","last_change":"2024-04-26T21:37:21.498893+0000","last_active":"2024-04-26T22:03:35.212554+0000","last_peered":"2024-04-26T22:03:35.212554+0000","last_clean":"2024-04-26T22:03:35.212554+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T22:03:35.212554+0000","last_undegraded":"2024-04-26T22:03:35.212554+0000","last_fullsized":"2024-04-26T22:03:35.212554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2388,"log_dups_size":0,"ondisk_log_size":2388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":100197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'512","reported_seq":548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.035449+0000","last_change":"2024-04-26T21:37:17.427611+0000","last_active":"2024-04-26T22:03:43.035449+0000","last_peered":"2024-04-26T22:03:43.035449+0000","last_clean":"2024-04-26T22:03:43.035449+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T22:03:43.035449+0000","last_undegraded":"2024-04-26T22:03:43.035449+0000","last_fullsized":"2024-04-26T22:03:43.035449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:27.274572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'2499","reported_seq":2537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746933+0000","last_change":"2024-04-26T21:37:16.437786+0000","last_active":"2024-04-26T22:03:36.746933+0000","last_peered":"2024-04-26T22:03:36.746933+0000","last_clean":"2024-04-26T22:03:36.746933+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T22:03:36.746933+0000","last_undegraded":"2024-04-26T22:03:36.746933+0000","last_fullsized":"2024-04-26T22:03:36.746933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2499,"log_dups_size":0,"ondisk_log_size":2499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2501,"num_write_kb":21681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2296","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.765515+0000","last_change":"2024-04-26T21:37:21.502087+0000","last_active":"2024-04-26T22:03:43.765515+0000","last_peered":"2024-04-26T22:03:43.765515+0000","last_clean":"2024-04-26T22:03:43.765515+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T22:03:43.765515+0000","last_undegraded":"2024-04-26T22:03:43.765515+0000","last_fullsized":"2024-04-26T22:03:43.765515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1815,"num_write_kb":51574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'506","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.027261+0000","last_change":"2024-04-26T21:37:17.434408+0000","last_active":"2024-04-26T22:03:43.027261+0000","last_peered":"2024-04-26T22:03:43.027261+0000","last_clean":"2024-04-26T22:03:43.027261+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T22:03:43.027261+0000","last_undegraded":"2024-04-26T22:03:43.027261+0000","last_fullsized":"2024-04-26T22:03:43.027261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4043","reported_seq":6761,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.743831+0000","last_change":"2024-04-26T21:37:16.422422+0000","last_active":"2024-04-26T22:03:43.743831+0000","last_peered":"2024-04-26T22:03:43.743831+0000","last_clean":"2024-04-26T22:03:43.743831+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T22:03:43.743831+0000","last_undegraded":"2024-04-26T22:03:43.743831+0000","last_fullsized":"2024-04-26T22:03:43.743831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15961989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":4049,"num_write_kb":18210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'1988","reported_seq":2019,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.765670+0000","last_change":"2024-04-26T21:37:21.489253+0000","last_active":"2024-04-26T22:03:43.765670+0000","last_peered":"2024-04-26T22:03:43.765670+0000","last_clean":"2024-04-26T22:03:43.765670+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T22:03:43.765670+0000","last_undegraded":"2024-04-26T22:03:43.765670+0000","last_fullsized":"2024-04-26T22:03:43.765670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":88301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'487","reported_seq":524,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.758167+0000","last_change":"2024-04-26T21:37:17.424436+0000","last_active":"2024-04-26T22:03:43.758167+0000","last_peered":"2024-04-26T22:03:43.758167+0000","last_clean":"2024-04-26T22:03:43.758167+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T22:03:43.758167+0000","last_undegraded":"2024-04-26T22:03:43.758167+0000","last_fullsized":"2024-04-26T22:03:43.758167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'2390","reported_seq":2429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.746379+0000","last_change":"2024-04-26T21:37:16.437510+0000","last_active":"2024-04-26T22:03:36.746379+0000","last_peered":"2024-04-26T22:03:36.746379+0000","last_clean":"2024-04-26T22:03:36.746379+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T22:03:36.746379+0000","last_undegraded":"2024-04-26T22:03:36.746379+0000","last_fullsized":"2024-04-26T22:03:36.746379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2392,"num_write_kb":17555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'2202","reported_seq":2233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.763667+0000","last_change":"2024-04-26T21:37:21.503238+0000","last_active":"2024-04-26T22:03:43.763667+0000","last_peered":"2024-04-26T22:03:43.763667+0000","last_clean":"2024-04-26T22:03:43.763667+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T22:03:43.763667+0000","last_undegraded":"2024-04-26T22:03:43.763667+0000","last_fullsized":"2024-04-26T22:03:43.763667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":59602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'492","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031237+0000","last_change":"2024-04-26T21:37:17.452192+0000","last_active":"2024-04-26T22:03:43.031237+0000","last_peered":"2024-04-26T22:03:43.031237+0000","last_clean":"2024-04-26T22:03:43.031237+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T22:03:43.031237+0000","last_undegraded":"2024-04-26T22:03:43.031237+0000","last_fullsized":"2024-04-26T22:03:43.031237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'937","reported_seq":975,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748385+0000","last_change":"2024-04-26T21:37:16.424902+0000","last_active":"2024-04-26T22:03:36.748385+0000","last_peered":"2024-04-26T22:03:36.748385+0000","last_clean":"2024-04-26T22:03:36.748385+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T22:03:36.748385+0000","last_undegraded":"2024-04-26T22:03:36.748385+0000","last_fullsized":"2024-04-26T22:03:36.748385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:27.566992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:01:09.729938+0000","last_change":"2024-04-26T21:37:06.856619+0000","last_active":"2024-04-26T22:01:09.729938+0000","last_peered":"2024-04-26T22:01:09.729938+0000","last_clean":"2024-04-26T22:01:09.729938+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T22:01:09.729938+0000","last_undegraded":"2024-04-26T22:01:09.729938+0000","last_fullsized":"2024-04-26T22:01:09.729938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:05.502776+0000","last_clean_scrub_stamp":"2024-04-26T21:37:05.502776+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:17.696760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2218","reported_seq":2248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186238+0000","last_change":"2024-04-26T21:37:21.507760+0000","last_active":"2024-04-26T22:03:35.186238+0000","last_peered":"2024-04-26T22:03:35.186238+0000","last_clean":"2024-04-26T22:03:35.186238+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T22:03:35.186238+0000","last_undegraded":"2024-04-26T22:03:35.186238+0000","last_fullsized":"2024-04-26T22:03:35.186238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1718,"num_write_kb":49388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'483","reported_seq":518,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051569+0000","last_change":"2024-04-26T21:37:17.457634+0000","last_active":"2024-04-26T22:03:43.051569+0000","last_peered":"2024-04-26T22:03:43.051569+0000","last_clean":"2024-04-26T22:03:43.051569+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T22:03:43.051569+0000","last_undegraded":"2024-04-26T22:03:43.051569+0000","last_fullsized":"2024-04-26T22:03:43.051569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:39.531821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'1337","reported_seq":1375,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.747613+0000","last_change":"2024-04-26T21:37:16.435784+0000","last_active":"2024-04-26T22:03:36.747613+0000","last_peered":"2024-04-26T22:03:36.747613+0000","last_clean":"2024-04-26T22:03:36.747613+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T22:03:36.747613+0000","last_undegraded":"2024-04-26T22:03:36.747613+0000","last_fullsized":"2024-04-26T22:03:36.747613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":12939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'2226","reported_seq":2256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.082628+0000","last_change":"2024-04-26T21:37:21.503010+0000","last_active":"2024-04-26T22:03:35.082628+0000","last_peered":"2024-04-26T22:03:35.082628+0000","last_clean":"2024-04-26T22:03:35.082628+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T22:03:35.082628+0000","last_undegraded":"2024-04-26T22:03:35.082628+0000","last_fullsized":"2024-04-26T22:03:35.082628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:20.365868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":82996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'526","reported_seq":561,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.034559+0000","last_change":"2024-04-26T21:37:17.443835+0000","last_active":"2024-04-26T22:03:43.034559+0000","last_peered":"2024-04-26T22:03:43.034559+0000","last_clean":"2024-04-26T22:03:43.034559+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T22:03:43.034559+0000","last_undegraded":"2024-04-26T22:03:43.034559+0000","last_fullsized":"2024-04-26T22:03:43.034559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2771","reported_seq":2809,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.742524+0000","last_change":"2024-04-26T21:37:16.436351+0000","last_active":"2024-04-26T22:03:36.742524+0000","last_peered":"2024-04-26T22:03:36.742524+0000","last_clean":"2024-04-26T22:03:36.742524+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T22:03:36.742524+0000","last_undegraded":"2024-04-26T22:03:36.742524+0000","last_fullsized":"2024-04-26T22:03:36.742524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2771,"log_dups_size":0,"ondisk_log_size":2771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971590,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2774,"num_write_kb":25944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1964","reported_seq":1994,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.014405+0000","last_change":"2024-04-26T21:37:21.494960+0000","last_active":"2024-04-26T22:03:35.014405+0000","last_peered":"2024-04-26T22:03:35.014405+0000","last_clean":"2024-04-26T22:03:35.014405+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T22:03:35.014405+0000","last_undegraded":"2024-04-26T22:03:35.014405+0000","last_fullsized":"2024-04-26T22:03:35.014405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'495","reported_seq":530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049581+0000","last_change":"2024-04-26T21:37:17.456145+0000","last_active":"2024-04-26T22:03:43.049581+0000","last_peered":"2024-04-26T22:03:43.049581+0000","last_clean":"2024-04-26T22:03:43.049581+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T22:03:43.049581+0000","last_undegraded":"2024-04-26T22:03:43.049581+0000","last_fullsized":"2024-04-26T22:03:43.049581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:54.916077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'1462","reported_seq":1508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:54.629595+0000","last_change":"2024-04-26T22:03:54.629633+0000","last_active":"2024-04-26T22:03:54.629595+0000","last_peered":"2024-04-26T22:03:54.629595+0000","last_clean":"2024-04-26T22:03:54.629595+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T22:03:54.629595+0000","last_undegraded":"2024-04-26T22:03:54.629595+0000","last_fullsized":"2024-04-26T22:03:54.629595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1462","last_scrub_stamp":"2024-04-26T22:03:54.629504+0000","last_deep_scrub":"26'1462","last_deep_scrub_stamp":"2024-04-26T22:03:54.629504+0000","last_clean_scrub_stamp":"2024-04-26T22:03:54.629504+0000","objects_scrubbed":3,"log_size":1462,"log_dups_size":0,"ondisk_log_size":1462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:34.436575+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1458,"num_write_kb":12981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'2194","reported_seq":2224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.194184+0000","last_change":"2024-04-26T21:37:21.499592+0000","last_active":"2024-04-26T22:03:35.194184+0000","last_peered":"2024-04-26T22:03:35.194184+0000","last_clean":"2024-04-26T22:03:35.194184+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T22:03:35.194184+0000","last_undegraded":"2024-04-26T22:03:35.194184+0000","last_fullsized":"2024-04-26T22:03:35.194184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:55.779592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":50061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'500","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044208+0000","last_change":"2024-04-26T21:37:17.456500+0000","last_active":"2024-04-26T22:03:43.044208+0000","last_peered":"2024-04-26T22:03:43.044208+0000","last_clean":"2024-04-26T22:03:43.044208+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T22:03:43.044208+0000","last_undegraded":"2024-04-26T22:03:43.044208+0000","last_fullsized":"2024-04-26T22:03:43.044208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:35.758249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1056","reported_seq":1093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744374+0000","last_change":"2024-04-26T21:37:16.426593+0000","last_active":"2024-04-26T22:03:37.744374+0000","last_peered":"2024-04-26T22:03:37.744374+0000","last_clean":"2024-04-26T22:03:37.744374+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T22:03:37.744374+0000","last_undegraded":"2024-04-26T22:03:37.744374+0000","last_fullsized":"2024-04-26T22:03:37.744374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1056,"log_dups_size":0,"ondisk_log_size":1056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:09.907028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":8718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2324","reported_seq":2361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.179489+0000","last_change":"2024-04-26T21:37:58.755793+0000","last_active":"2024-04-26T22:03:35.179489+0000","last_peered":"2024-04-26T22:03:35.179489+0000","last_clean":"2024-04-26T22:03:35.179489+0000","last_became_active":"2024-04-26T21:37:58.754532+0000","last_became_peered":"2024-04-26T21:37:58.754532+0000","last_unstale":"2024-04-26T22:03:35.179489+0000","last_undegraded":"2024-04-26T22:03:35.179489+0000","last_fullsized":"2024-04-26T22:03:35.179489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:33.156609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":34587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'539","reported_seq":574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.043597+0000","last_change":"2024-04-26T21:37:17.435653+0000","last_active":"2024-04-26T22:03:43.043597+0000","last_peered":"2024-04-26T22:03:43.043597+0000","last_clean":"2024-04-26T22:03:43.043597+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T22:03:43.043597+0000","last_undegraded":"2024-04-26T22:03:43.043597+0000","last_fullsized":"2024-04-26T22:03:43.043597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'941","reported_seq":979,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:39.731471+0000","last_change":"2024-04-26T21:37:16.428213+0000","last_active":"2024-04-26T22:03:39.731471+0000","last_peered":"2024-04-26T22:03:39.731471+0000","last_clean":"2024-04-26T22:03:39.731471+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T22:03:39.731471+0000","last_undegraded":"2024-04-26T22:03:39.731471+0000","last_fullsized":"2024-04-26T22:03:39.731471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":8676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'1956","reported_seq":1985,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.737681+0000","last_change":"2024-04-26T21:37:21.502136+0000","last_active":"2024-04-26T22:03:35.737681+0000","last_peered":"2024-04-26T22:03:35.737681+0000","last_clean":"2024-04-26T22:03:35.737681+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T22:03:35.737681+0000","last_undegraded":"2024-04-26T22:03:35.737681+0000","last_fullsized":"2024-04-26T22:03:35.737681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1956,"log_dups_size":0,"ondisk_log_size":1956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1477,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'502","reported_seq":537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031635+0000","last_change":"2024-04-26T21:37:17.454392+0000","last_active":"2024-04-26T22:03:43.031635+0000","last_peered":"2024-04-26T22:03:43.031635+0000","last_clean":"2024-04-26T22:03:43.031635+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T22:03:43.031635+0000","last_undegraded":"2024-04-26T22:03:43.031635+0000","last_fullsized":"2024-04-26T22:03:43.031635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'16","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748578+0000","last_change":"2024-04-26T21:37:16.440855+0000","last_active":"2024-04-26T22:03:36.748578+0000","last_peered":"2024-04-26T22:03:36.748578+0000","last_clean":"2024-04-26T22:03:36.748578+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T22:03:36.748578+0000","last_undegraded":"2024-04-26T22:03:36.748578+0000","last_fullsized":"2024-04-26T22:03:36.748578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2142","reported_seq":2170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.227910+0000","last_change":"2024-04-26T21:37:21.495188+0000","last_active":"2024-04-26T22:03:35.227910+0000","last_peered":"2024-04-26T22:03:35.227910+0000","last_clean":"2024-04-26T22:03:35.227910+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T22:03:35.227910+0000","last_undegraded":"2024-04-26T22:03:35.227910+0000","last_fullsized":"2024-04-26T22:03:35.227910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:14.967725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1648,"num_write_kb":35594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'514","reported_seq":536,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046658+0000","last_change":"2024-04-26T21:37:58.752144+0000","last_active":"2024-04-26T22:03:43.046658+0000","last_peered":"2024-04-26T22:03:43.046658+0000","last_clean":"2024-04-26T22:03:43.046658+0000","last_became_active":"2024-04-26T21:37:58.751458+0000","last_became_peered":"2024-04-26T21:37:58.751458+0000","last_unstale":"2024-04-26T22:03:43.046658+0000","last_undegraded":"2024-04-26T22:03:43.046658+0000","last_fullsized":"2024-04-26T22:03:43.046658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.744268+0000","last_change":"2024-04-26T21:37:16.437551+0000","last_active":"2024-04-26T22:03:37.744268+0000","last_peered":"2024-04-26T22:03:37.744268+0000","last_clean":"2024-04-26T22:03:37.744268+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T22:03:37.744268+0000","last_undegraded":"2024-04-26T22:03:37.744268+0000","last_fullsized":"2024-04-26T22:03:37.744268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'2060","reported_seq":2089,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.191326+0000","last_change":"2024-04-26T21:37:21.480298+0000","last_active":"2024-04-26T22:03:35.191326+0000","last_peered":"2024-04-26T22:03:35.191326+0000","last_clean":"2024-04-26T22:03:35.191326+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T22:03:35.191326+0000","last_undegraded":"2024-04-26T22:03:35.191326+0000","last_fullsized":"2024-04-26T22:03:35.191326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:35.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1564,"num_write_kb":74671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'496","reported_seq":532,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047189+0000","last_change":"2024-04-26T21:37:17.431391+0000","last_active":"2024-04-26T22:03:43.047189+0000","last_peered":"2024-04-26T22:03:43.047189+0000","last_clean":"2024-04-26T22:03:43.047189+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T22:03:43.047189+0000","last_undegraded":"2024-04-26T22:03:43.047189+0000","last_fullsized":"2024-04-26T22:03:43.047189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'1739","reported_seq":1785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:54.666337+0000","last_change":"2024-04-26T22:03:54.666377+0000","last_active":"2024-04-26T22:03:54.666337+0000","last_peered":"2024-04-26T22:03:54.666337+0000","last_clean":"2024-04-26T22:03:54.666337+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T22:03:54.666337+0000","last_undegraded":"2024-04-26T22:03:54.666337+0000","last_fullsized":"2024-04-26T22:03:54.666337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1739","last_scrub_stamp":"2024-04-26T22:03:54.666244+0000","last_deep_scrub":"26'1739","last_deep_scrub_stamp":"2024-04-26T22:03:54.666244+0000","last_clean_scrub_stamp":"2024-04-26T22:03:54.666244+0000","objects_scrubbed":3,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:14.600381+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1738,"num_write_kb":13055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'1982","reported_seq":2010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.219591+0000","last_change":"2024-04-26T21:37:21.485954+0000","last_active":"2024-04-26T22:03:35.219591+0000","last_peered":"2024-04-26T22:03:35.219591+0000","last_clean":"2024-04-26T22:03:35.219591+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T22:03:35.219591+0000","last_undegraded":"2024-04-26T22:03:35.219591+0000","last_fullsized":"2024-04-26T22:03:35.219591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1494,"num_write_kb":56826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'493","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050314+0000","last_change":"2024-04-26T21:37:17.435422+0000","last_active":"2024-04-26T22:03:43.050314+0000","last_peered":"2024-04-26T22:03:43.050314+0000","last_clean":"2024-04-26T22:03:43.050314+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T22:03:43.050314+0000","last_undegraded":"2024-04-26T22:03:43.050314+0000","last_fullsized":"2024-04-26T22:03:43.050314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:41.949914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'2893","reported_seq":2930,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:29.293347+0000","last_change":"2024-04-26T21:37:16.441220+0000","last_active":"2024-04-26T22:03:29.293347+0000","last_peered":"2024-04-26T22:03:29.293347+0000","last_clean":"2024-04-26T22:03:29.293347+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T22:03:29.293347+0000","last_undegraded":"2024-04-26T22:03:29.293347+0000","last_fullsized":"2024-04-26T22:03:29.293347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:55:46.711222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2889,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'2295","reported_seq":2325,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.761185+0000","last_change":"2024-04-26T21:37:21.502322+0000","last_active":"2024-04-26T22:03:43.761185+0000","last_peered":"2024-04-26T22:03:43.761185+0000","last_clean":"2024-04-26T22:03:43.761185+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T22:03:43.761185+0000","last_undegraded":"2024-04-26T22:03:43.761185+0000","last_fullsized":"2024-04-26T22:03:43.761185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":114189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'491","reported_seq":526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047946+0000","last_change":"2024-04-26T21:37:17.422336+0000","last_active":"2024-04-26T22:03:43.047946+0000","last_peered":"2024-04-26T22:03:43.047946+0000","last_clean":"2024-04-26T22:03:43.047946+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T22:03:43.047946+0000","last_undegraded":"2024-04-26T22:03:43.047946+0000","last_fullsized":"2024-04-26T22:03:43.047946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:35.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3654","reported_seq":3692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:53.845916+0000","last_change":"2024-04-26T21:37:16.437434+0000","last_active":"2024-04-26T22:03:53.845916+0000","last_peered":"2024-04-26T22:03:53.845916+0000","last_clean":"2024-04-26T22:03:53.845916+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T22:03:53.845916+0000","last_undegraded":"2024-04-26T22:03:53.845916+0000","last_fullsized":"2024-04-26T22:03:53.845916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3659,"num_write_kb":22929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'2192","reported_seq":2221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.186824+0000","last_change":"2024-04-26T21:37:21.500416+0000","last_active":"2024-04-26T22:03:35.186824+0000","last_peered":"2024-04-26T22:03:35.186824+0000","last_clean":"2024-04-26T22:03:35.186824+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T22:03:35.186824+0000","last_undegraded":"2024-04-26T22:03:35.186824+0000","last_fullsized":"2024-04-26T22:03:35.186824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2192,"log_dups_size":0,"ondisk_log_size":2192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:39.810660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":143042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'491","reported_seq":527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:53.158602+0000","last_change":"2024-04-26T21:37:17.451521+0000","last_active":"2024-04-26T22:03:53.158602+0000","last_peered":"2024-04-26T22:03:53.158602+0000","last_clean":"2024-04-26T22:03:53.158602+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T22:03:53.158602+0000","last_undegraded":"2024-04-26T22:03:53.158602+0000","last_fullsized":"2024-04-26T22:03:53.158602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2006","reported_seq":2043,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.748778+0000","last_change":"2024-04-26T21:37:16.446442+0000","last_active":"2024-04-26T22:03:36.748778+0000","last_peered":"2024-04-26T22:03:36.748778+0000","last_clean":"2024-04-26T22:03:36.748778+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T22:03:36.748778+0000","last_undegraded":"2024-04-26T22:03:36.748778+0000","last_fullsized":"2024-04-26T22:03:36.748778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.559786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":21501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'2154","reported_seq":2183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.152690+0000","last_change":"2024-04-26T21:37:21.496900+0000","last_active":"2024-04-26T22:03:35.152690+0000","last_peered":"2024-04-26T22:03:35.152690+0000","last_clean":"2024-04-26T22:03:35.152690+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T22:03:35.152690+0000","last_undegraded":"2024-04-26T22:03:35.152690+0000","last_fullsized":"2024-04-26T22:03:35.152690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:18.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1666,"num_write_kb":39964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'495","reported_seq":516,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.046347+0000","last_change":"2024-04-26T21:37:58.753596+0000","last_active":"2024-04-26T22:03:43.046347+0000","last_peered":"2024-04-26T22:03:43.046347+0000","last_clean":"2024-04-26T22:03:43.046347+0000","last_became_active":"2024-04-26T21:37:58.752756+0000","last_became_peered":"2024-04-26T21:37:58.752756+0000","last_unstale":"2024-04-26T22:03:43.046347+0000","last_undegraded":"2024-04-26T22:03:43.046347+0000","last_fullsized":"2024-04-26T22:03:43.046347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'566","reported_seq":603,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:36.749533+0000","last_change":"2024-04-26T21:37:16.444382+0000","last_active":"2024-04-26T22:03:36.749533+0000","last_peered":"2024-04-26T22:03:36.749533+0000","last_clean":"2024-04-26T22:03:36.749533+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T22:03:36.749533+0000","last_undegraded":"2024-04-26T22:03:36.749533+0000","last_fullsized":"2024-04-26T22:03:36.749533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'2246","reported_seq":2275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.171910+0000","last_change":"2024-04-26T21:37:21.493061+0000","last_active":"2024-04-26T22:03:35.171910+0000","last_peered":"2024-04-26T22:03:35.171910+0000","last_clean":"2024-04-26T22:03:35.171910+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T22:03:35.171910+0000","last_undegraded":"2024-04-26T22:03:35.171910+0000","last_fullsized":"2024-04-26T22:03:35.171910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.198509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1740,"num_write_kb":51745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'2287","reported_seq":2319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.766846+0000","last_change":"2024-04-26T21:37:21.502469+0000","last_active":"2024-04-26T22:03:43.766846+0000","last_peered":"2024-04-26T22:03:43.766846+0000","last_clean":"2024-04-26T22:03:43.766846+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T22:03:43.766846+0000","last_undegraded":"2024-04-26T22:03:43.766846+0000","last_fullsized":"2024-04-26T22:03:43.766846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1846,"num_write_kb":61262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'494","reported_seq":538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:53.993596+0000","last_change":"2024-04-26T22:03:53.993596+0000","last_active":"2024-04-26T22:03:53.993596+0000","last_peered":"2024-04-26T22:03:53.993596+0000","last_clean":"2024-04-26T22:03:53.993596+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T22:03:53.993596+0000","last_undegraded":"2024-04-26T22:03:53.993596+0000","last_fullsized":"2024-04-26T22:03:53.993596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'494","last_scrub_stamp":"2024-04-26T22:03:53.993304+0000","last_deep_scrub":"26'494","last_deep_scrub_stamp":"2024-04-26T22:03:53.993304+0000","last_clean_scrub_stamp":"2024-04-26T22:03:53.993304+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:06.766446+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2601","reported_seq":2638,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.749080+0000","last_change":"2024-04-26T21:37:16.434763+0000","last_active":"2024-04-26T22:03:37.749080+0000","last_peered":"2024-04-26T22:03:37.749080+0000","last_clean":"2024-04-26T22:03:37.749080+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T22:03:37.749080+0000","last_undegraded":"2024-04-26T22:03:37.749080+0000","last_fullsized":"2024-04-26T22:03:37.749080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:30:19.309952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2601,"num_write_kb":21771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'2012","reported_seq":2042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.213549+0000","last_change":"2024-04-26T21:37:21.506132+0000","last_active":"2024-04-26T22:03:35.213549+0000","last_peered":"2024-04-26T22:03:35.213549+0000","last_clean":"2024-04-26T22:03:35.213549+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T22:03:35.213549+0000","last_undegraded":"2024-04-26T22:03:35.213549+0000","last_fullsized":"2024-04-26T22:03:35.213549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:46.002326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1553,"num_write_kb":109022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'573","reported_seq":608,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036354+0000","last_change":"2024-04-26T21:37:17.451866+0000","last_active":"2024-04-26T22:03:43.036354+0000","last_peered":"2024-04-26T22:03:43.036354+0000","last_clean":"2024-04-26T22:03:43.036354+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T22:03:43.036354+0000","last_undegraded":"2024-04-26T22:03:43.036354+0000","last_fullsized":"2024-04-26T22:03:43.036354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:39.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'453","reported_seq":490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.747189+0000","last_change":"2024-04-26T21:37:16.432690+0000","last_active":"2024-04-26T22:03:37.747189+0000","last_peered":"2024-04-26T22:03:37.747189+0000","last_clean":"2024-04-26T22:03:37.747189+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T22:03:37.747189+0000","last_undegraded":"2024-04-26T22:03:37.747189+0000","last_fullsized":"2024-04-26T22:03:37.747189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:47.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3504","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.750936+0000","last_change":"2024-04-26T21:37:16.439307+0000","last_active":"2024-04-26T22:03:37.750936+0000","last_peered":"2024-04-26T22:03:37.750936+0000","last_clean":"2024-04-26T22:03:37.750936+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T22:03:37.750936+0000","last_undegraded":"2024-04-26T22:03:37.750936+0000","last_fullsized":"2024-04-26T22:03:37.750936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:57.801019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3514,"num_write_kb":30405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'488","reported_seq":523,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047363+0000","last_change":"2024-04-26T21:37:17.438924+0000","last_active":"2024-04-26T22:03:43.047363+0000","last_peered":"2024-04-26T22:03:43.047363+0000","last_clean":"2024-04-26T22:03:43.047363+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T22:03:43.047363+0000","last_undegraded":"2024-04-26T22:03:43.047363+0000","last_fullsized":"2024-04-26T22:03:43.047363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'2142","reported_seq":2178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.162687+0000","last_change":"2024-04-26T21:37:59.072851+0000","last_active":"2024-04-26T22:03:35.162687+0000","last_peered":"2024-04-26T22:03:35.162687+0000","last_clean":"2024-04-26T22:03:35.162687+0000","last_became_active":"2024-04-26T21:37:59.071221+0000","last_became_peered":"2024-04-26T21:37:59.071221+0000","last_unstale":"2024-04-26T22:03:35.162687+0000","last_undegraded":"2024-04-26T22:03:35.162687+0000","last_fullsized":"2024-04-26T22:03:35.162687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1199","reported_seq":1235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:37.748058+0000","last_change":"2024-04-26T21:37:16.426462+0000","last_active":"2024-04-26T22:03:37.748058+0000","last_peered":"2024-04-26T22:03:37.748058+0000","last_clean":"2024-04-26T22:03:37.748058+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T22:03:37.748058+0000","last_undegraded":"2024-04-26T22:03:37.748058+0000","last_fullsized":"2024-04-26T22:03:37.748058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:15.371653+0000","last_clean_scrub_stamp":"2024-04-26T21:37:15.371653+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:18.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'501","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038699+0000","last_change":"2024-04-26T21:37:17.433014+0000","last_active":"2024-04-26T22:03:43.038699+0000","last_peered":"2024-04-26T22:03:43.038699+0000","last_clean":"2024-04-26T22:03:43.038699+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T22:03:43.038699+0000","last_undegraded":"2024-04-26T22:03:43.038699+0000","last_fullsized":"2024-04-26T22:03:43.038699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:28.581794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'1931","reported_seq":1959,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:35.228754+0000","last_change":"2024-04-26T21:37:21.496466+0000","last_active":"2024-04-26T22:03:35.228754+0000","last_peered":"2024-04-26T22:03:35.228754+0000","last_clean":"2024-04-26T22:03:35.228754+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T22:03:35.228754+0000","last_undegraded":"2024-04-26T22:03:35.228754+0000","last_fullsized":"2024-04-26T22:03:35.228754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:20.438867+0000","last_clean_scrub_stamp":"2024-04-26T21:37:20.438867+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:45.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1423,"num_write_kb":55204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'524","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.042836+0000","last_change":"2024-04-26T21:37:17.450474+0000","last_active":"2024-04-26T22:03:43.042836+0000","last_peered":"2024-04-26T22:03:43.042836+0000","last_clean":"2024-04-26T22:03:43.042836+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T22:03:43.042836+0000","last_undegraded":"2024-04-26T22:03:43.042836+0000","last_fullsized":"2024-04-26T22:03:43.042836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:32.168859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'551","reported_seq":588,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.023205+0000","last_change":"2024-04-26T21:37:17.454714+0000","last_active":"2024-04-26T22:03:43.023205+0000","last_peered":"2024-04-26T22:03:43.023205+0000","last_clean":"2024-04-26T22:03:43.023205+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T22:03:43.023205+0000","last_undegraded":"2024-04-26T22:03:43.023205+0000","last_fullsized":"2024-04-26T22:03:43.023205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'499","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.029683+0000","last_change":"2024-04-26T21:37:17.436079+0000","last_active":"2024-04-26T22:03:43.029683+0000","last_peered":"2024-04-26T22:03:43.029683+0000","last_clean":"2024-04-26T22:03:43.029683+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T22:03:43.029683+0000","last_undegraded":"2024-04-26T22:03:43.029683+0000","last_fullsized":"2024-04-26T22:03:43.029683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'508","reported_seq":545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031607+0000","last_change":"2024-04-26T21:37:17.439181+0000","last_active":"2024-04-26T22:03:43.031607+0000","last_peered":"2024-04-26T22:03:43.031607+0000","last_clean":"2024-04-26T22:03:43.031607+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T22:03:43.031607+0000","last_undegraded":"2024-04-26T22:03:43.031607+0000","last_fullsized":"2024-04-26T22:03:43.031607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'476","reported_seq":512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045803+0000","last_change":"2024-04-26T21:37:17.428097+0000","last_active":"2024-04-26T22:03:43.045803+0000","last_peered":"2024-04-26T22:03:43.045803+0000","last_clean":"2024-04-26T22:03:43.045803+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T22:03:43.045803+0000","last_undegraded":"2024-04-26T22:03:43.045803+0000","last_fullsized":"2024-04-26T22:03:43.045803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'489","reported_seq":526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026367+0000","last_change":"2024-04-26T21:37:17.432379+0000","last_active":"2024-04-26T22:03:43.026367+0000","last_peered":"2024-04-26T22:03:43.026367+0000","last_clean":"2024-04-26T22:03:43.026367+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T22:03:43.026367+0000","last_undegraded":"2024-04-26T22:03:43.026367+0000","last_fullsized":"2024-04-26T22:03:43.026367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'522","reported_seq":558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050293+0000","last_change":"2024-04-26T21:37:17.446393+0000","last_active":"2024-04-26T22:03:43.050293+0000","last_peered":"2024-04-26T22:03:43.050293+0000","last_clean":"2024-04-26T22:03:43.050293+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T22:03:43.050293+0000","last_undegraded":"2024-04-26T22:03:43.050293+0000","last_fullsized":"2024-04-26T22:03:43.050293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:16.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'475","reported_seq":511,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047218+0000","last_change":"2024-04-26T21:37:17.447129+0000","last_active":"2024-04-26T22:03:43.047218+0000","last_peered":"2024-04-26T22:03:43.047218+0000","last_clean":"2024-04-26T22:03:43.047218+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T22:03:43.047218+0000","last_undegraded":"2024-04-26T22:03:43.047218+0000","last_fullsized":"2024-04-26T22:03:43.047218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'513","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.031438+0000","last_change":"2024-04-26T21:37:58.751645+0000","last_active":"2024-04-26T22:03:43.031438+0000","last_peered":"2024-04-26T22:03:43.031438+0000","last_clean":"2024-04-26T22:03:43.031438+0000","last_became_active":"2024-04-26T21:37:58.749833+0000","last_became_peered":"2024-04-26T21:37:58.749833+0000","last_unstale":"2024-04-26T22:03:43.031438+0000","last_undegraded":"2024-04-26T22:03:43.031438+0000","last_fullsized":"2024-04-26T22:03:43.031438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"26'482","reported_seq":517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.045694+0000","last_change":"2024-04-26T21:37:17.433117+0000","last_active":"2024-04-26T22:03:43.045694+0000","last_peered":"2024-04-26T22:03:43.045694+0000","last_clean":"2024-04-26T22:03:43.045694+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T22:03:43.045694+0000","last_undegraded":"2024-04-26T22:03:43.045694+0000","last_fullsized":"2024-04-26T22:03:43.045694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'530","reported_seq":565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.047951+0000","last_change":"2024-04-26T21:37:17.449960+0000","last_active":"2024-04-26T22:03:43.047951+0000","last_peered":"2024-04-26T22:03:43.047951+0000","last_clean":"2024-04-26T22:03:43.047951+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T22:03:43.047951+0000","last_undegraded":"2024-04-26T22:03:43.047951+0000","last_fullsized":"2024-04-26T22:03:43.047951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'488","reported_seq":532,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:53.662483+0000","last_change":"2024-04-26T22:03:53.662517+0000","last_active":"2024-04-26T22:03:53.662483+0000","last_peered":"2024-04-26T22:03:53.662483+0000","last_clean":"2024-04-26T22:03:53.662483+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T22:03:53.662483+0000","last_undegraded":"2024-04-26T22:03:53.662483+0000","last_fullsized":"2024-04-26T22:03:53.662483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'488","last_scrub_stamp":"2024-04-26T22:03:53.662384+0000","last_deep_scrub":"26'488","last_deep_scrub_stamp":"2024-04-26T22:03:53.662384+0000","last_clean_scrub_stamp":"2024-04-26T22:03:53.662384+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:54.185519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'512","reported_seq":547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044243+0000","last_change":"2024-04-26T21:37:17.444844+0000","last_active":"2024-04-26T22:03:43.044243+0000","last_peered":"2024-04-26T22:03:43.044243+0000","last_clean":"2024-04-26T22:03:43.044243+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T22:03:43.044243+0000","last_undegraded":"2024-04-26T22:03:43.044243+0000","last_fullsized":"2024-04-26T22:03:43.044243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:30.431445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'505","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.049561+0000","last_change":"2024-04-26T21:37:17.441265+0000","last_active":"2024-04-26T22:03:43.049561+0000","last_peered":"2024-04-26T22:03:43.049561+0000","last_clean":"2024-04-26T22:03:43.049561+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T22:03:43.049561+0000","last_undegraded":"2024-04-26T22:03:43.049561+0000","last_fullsized":"2024-04-26T22:03:43.049561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'459","reported_seq":495,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039416+0000","last_change":"2024-04-26T21:37:17.446019+0000","last_active":"2024-04-26T22:03:43.039416+0000","last_peered":"2024-04-26T22:03:43.039416+0000","last_clean":"2024-04-26T22:03:43.039416+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T22:03:43.039416+0000","last_undegraded":"2024-04-26T22:03:43.039416+0000","last_fullsized":"2024-04-26T22:03:43.039416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'525","reported_seq":560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050851+0000","last_change":"2024-04-26T21:37:17.449242+0000","last_active":"2024-04-26T22:03:43.050851+0000","last_peered":"2024-04-26T22:03:43.050851+0000","last_clean":"2024-04-26T22:03:43.050851+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T22:03:43.050851+0000","last_undegraded":"2024-04-26T22:03:43.050851+0000","last_fullsized":"2024-04-26T22:03:43.050851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:36.485270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'520","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037528+0000","last_change":"2024-04-26T21:37:17.453411+0000","last_active":"2024-04-26T22:03:43.037528+0000","last_peered":"2024-04-26T22:03:43.037528+0000","last_clean":"2024-04-26T22:03:43.037528+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T22:03:43.037528+0000","last_undegraded":"2024-04-26T22:03:43.037528+0000","last_fullsized":"2024-04-26T22:03:43.037528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'505","reported_seq":541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.028338+0000","last_change":"2024-04-26T21:37:17.428569+0000","last_active":"2024-04-26T22:03:43.028338+0000","last_peered":"2024-04-26T22:03:43.028338+0000","last_clean":"2024-04-26T22:03:43.028338+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T22:03:43.028338+0000","last_undegraded":"2024-04-26T22:03:43.028338+0000","last_fullsized":"2024-04-26T22:03:43.028338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'510","reported_seq":546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.760950+0000","last_change":"2024-04-26T21:37:17.439300+0000","last_active":"2024-04-26T22:03:43.760950+0000","last_peered":"2024-04-26T22:03:43.760950+0000","last_clean":"2024-04-26T22:03:43.760950+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T22:03:43.760950+0000","last_undegraded":"2024-04-26T22:03:43.760950+0000","last_fullsized":"2024-04-26T22:03:43.760950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'476","reported_seq":511,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036630+0000","last_change":"2024-04-26T21:37:17.447264+0000","last_active":"2024-04-26T22:03:43.036630+0000","last_peered":"2024-04-26T22:03:43.036630+0000","last_clean":"2024-04-26T22:03:43.036630+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T22:03:43.036630+0000","last_undegraded":"2024-04-26T22:03:43.036630+0000","last_fullsized":"2024-04-26T22:03:43.036630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'494","reported_seq":529,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.039352+0000","last_change":"2024-04-26T21:37:17.447642+0000","last_active":"2024-04-26T22:03:43.039352+0000","last_peered":"2024-04-26T22:03:43.039352+0000","last_clean":"2024-04-26T22:03:43.039352+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T22:03:43.039352+0000","last_undegraded":"2024-04-26T22:03:43.039352+0000","last_fullsized":"2024-04-26T22:03:43.039352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:58.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'475","reported_seq":510,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.032223+0000","last_change":"2024-04-26T21:37:17.459095+0000","last_active":"2024-04-26T22:03:43.032223+0000","last_peered":"2024-04-26T22:03:43.032223+0000","last_clean":"2024-04-26T22:03:43.032223+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T22:03:43.032223+0000","last_undegraded":"2024-04-26T22:03:43.032223+0000","last_fullsized":"2024-04-26T22:03:43.032223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:31.217765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'485","reported_seq":520,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050168+0000","last_change":"2024-04-26T21:37:17.459216+0000","last_active":"2024-04-26T22:03:43.050168+0000","last_peered":"2024-04-26T22:03:43.050168+0000","last_clean":"2024-04-26T22:03:43.050168+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T22:03:43.050168+0000","last_undegraded":"2024-04-26T22:03:43.050168+0000","last_fullsized":"2024-04-26T22:03:43.050168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:03.537747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'506","reported_seq":541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.051709+0000","last_change":"2024-04-26T21:37:17.458983+0000","last_active":"2024-04-26T22:03:43.051709+0000","last_peered":"2024-04-26T22:03:43.051709+0000","last_clean":"2024-04-26T22:03:43.051709+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T22:03:43.051709+0000","last_undegraded":"2024-04-26T22:03:43.051709+0000","last_fullsized":"2024-04-26T22:03:43.051709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:59.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'470","reported_seq":491,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.027964+0000","last_change":"2024-04-26T21:37:59.071288+0000","last_active":"2024-04-26T22:03:43.027964+0000","last_peered":"2024-04-26T22:03:43.027964+0000","last_clean":"2024-04-26T22:03:43.027964+0000","last_became_active":"2024-04-26T21:37:59.070372+0000","last_became_peered":"2024-04-26T21:37:59.070372+0000","last_unstale":"2024-04-26T22:03:43.027964+0000","last_undegraded":"2024-04-26T22:03:43.027964+0000","last_fullsized":"2024-04-26T22:03:43.027964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'485","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.037366+0000","last_change":"2024-04-26T21:37:17.450427+0000","last_active":"2024-04-26T22:03:43.037366+0000","last_peered":"2024-04-26T22:03:43.037366+0000","last_clean":"2024-04-26T22:03:43.037366+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T22:03:43.037366+0000","last_undegraded":"2024-04-26T22:03:43.037366+0000","last_fullsized":"2024-04-26T22:03:43.037366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'482","reported_seq":516,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.038091+0000","last_change":"2024-04-26T21:37:17.448774+0000","last_active":"2024-04-26T22:03:43.038091+0000","last_peered":"2024-04-26T22:03:43.038091+0000","last_clean":"2024-04-26T22:03:43.038091+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T22:03:43.038091+0000","last_undegraded":"2024-04-26T22:03:43.038091+0000","last_fullsized":"2024-04-26T22:03:43.038091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:04.119493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'509","reported_seq":543,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.044575+0000","last_change":"2024-04-26T21:37:17.445518+0000","last_active":"2024-04-26T22:03:43.044575+0000","last_peered":"2024-04-26T22:03:43.044575+0000","last_clean":"2024-04-26T22:03:43.044575+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T22:03:43.044575+0000","last_undegraded":"2024-04-26T22:03:43.044575+0000","last_fullsized":"2024-04-26T22:03:43.044575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.843584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'509","reported_seq":546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.036324+0000","last_change":"2024-04-26T21:37:17.451106+0000","last_active":"2024-04-26T22:03:43.036324+0000","last_peered":"2024-04-26T22:03:43.036324+0000","last_clean":"2024-04-26T22:03:43.036324+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T22:03:43.036324+0000","last_undegraded":"2024-04-26T22:03:43.036324+0000","last_fullsized":"2024-04-26T22:03:43.036324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:00.558907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'488","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.026729+0000","last_change":"2024-04-26T21:37:17.443419+0000","last_active":"2024-04-26T22:03:43.026729+0000","last_peered":"2024-04-26T22:03:43.026729+0000","last_clean":"2024-04-26T22:03:43.026729+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T22:03:43.026729+0000","last_undegraded":"2024-04-26T22:03:43.026729+0000","last_fullsized":"2024-04-26T22:03:43.026729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'487","reported_seq":524,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.762791+0000","last_change":"2024-04-26T21:37:17.449120+0000","last_active":"2024-04-26T22:03:43.762791+0000","last_peered":"2024-04-26T22:03:43.762791+0000","last_clean":"2024-04-26T22:03:43.762791+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T22:03:43.762791+0000","last_undegraded":"2024-04-26T22:03:43.762791+0000","last_fullsized":"2024-04-26T22:03:43.762791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'477","reported_seq":513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:43.050222+0000","last_change":"2024-04-26T21:37:17.460855+0000","last_active":"2024-04-26T22:03:43.050222+0000","last_peered":"2024-04-26T22:03:43.050222+0000","last_clean":"2024-04-26T22:03:43.050222+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T22:03:43.050222+0000","last_undegraded":"2024-04-26T22:03:43.050222+0000","last_fullsized":"2024-04-26T22:03:43.050222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:37:16.386455+0000","last_clean_scrub_stamp":"2024-04-26T21:37:16.386455+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:37.453051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52831,"num_write_kb":2071742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68463,"ondisk_log_size":68463,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31956,"ondisk_log_size":31956,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":240165372,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":58367,"num_write_kb":440918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":480387072,"data_stored":480330744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55423,"ondisk_log_size":55423,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575172,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279712,"kb_used_data":50008,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94092128,"statfs":{"total":96636764160,"available":96350339072,"internally_reserved":0,"allocated":51208192,"data_stored":51036951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575172,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325156,"kb_used_data":63580,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94046684,"statfs":{"total":96636764160,"available":96303804416,"internally_reserved":0,"allocated":65105920,"data_stored":64933386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575173,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":69908,"kb_used_omap":1,"kb_used_meta":233726,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":71585792,"data_stored":71417611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239335877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575173,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309348,"kb_used_data":65820,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94062492,"statfs":{"total":96636764160,"available":96319991808,"internally_reserved":0,"allocated":67399680,"data_stored":67223343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249362886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575172,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397252,"kb_used_data":73212,"kb_used_omap":1,"kb_used_meta":324030,"kb_avail":93974588,"statfs":{"total":96636764160,"available":96229978112,"internally_reserved":0,"allocated":74969088,"data_stored":74797270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":331807175},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575174,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211836,"kb_used_data":36340,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94160004,"statfs":{"total":96636764160,"available":96419844096,"internally_reserved":0,"allocated":37212160,"data_stored":37047862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575174,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":427684,"kb_used_data":75868,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93944156,"statfs":{"total":96636764160,"available":96198815744,"internally_reserved":0,"allocated":77688832,"data_stored":77515786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575172,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257640,"kb_used_data":37728,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94114200,"statfs":{"total":96636764160,"available":96372940800,"internally_reserved":0,"allocated":38633472,"data_stored":38454095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225180102},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77410304,"data_stored":77401433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36933632,"data_stored":36933509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74690560,"data_stored":74682917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":67121152,"data_stored":67108990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64827392,"data_stored":64819033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:03:58.701 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.702 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.703 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.704 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.705 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T21:37:05.502776+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.706 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.707 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.708 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.709 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.710 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-26T21:37:15.371653+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T21:37:20.438867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.711 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.712 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.713 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.714 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.714 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.714 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.714 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T21:37:16.386455+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=37, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=3, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:03:58.714 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T22:04:10.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:04:10.117 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:04:18.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:04:18.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.934+0000 7fe74a200640 1 Processor -- start 2024-04-26T22:04:18.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.934+0000 7fe74a200640 1 -- start start 2024-04-26T22:04:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe74a200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7440b6e40 0x7fe744145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe74a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe744149060 0x7fe74414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe74a200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7440b7220 con 0x7fe7440b0be0 2024-04-26T22:04:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe74a200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe744145860 con 0x7fe7440b6e40 2024-04-26T22:04:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe74a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe7441454f0 con 0x7fe744149060 2024-04-26T22:04:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe743400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7440b6e40 0x7fe744145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe743e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe744149060 0x7fe74414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe743400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7440b6e40 0x7fe744145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.5:54632/0 (socket says 172.21.15.5:54632) 2024-04-26T22:04:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.936+0000 7fe743400640 1 -- 172.21.15.5:0/918497953 learned_addr learned my addr 172.21.15.5:0/918497953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.937+0000 7fe743e00640 1 -- 172.21.15.5:0/918497953 >> v2:172.21.15.112:3300/0 conn(0x7fe7440b6e40 msgr2=0x7fe744145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.937+0000 7fe743e00640 1 --2- 172.21.15.5:0/918497953 >> v2:172.21.15.112:3300/0 conn(0x7fe7440b6e40 0x7fe744145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.937+0000 7fe743e00640 1 -- 172.21.15.5:0/918497953 >> v1:172.21.15.112:6789/0 conn(0x7fe7440b0be0 legacy=0x7fe744148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.937+0000 7fe743e00640 1 -- 172.21.15.5:0/918497953 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7440b30e0 con 0x7fe744149060 2024-04-26T22:04:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.937+0000 7fe743400640 1 --2- 172.21.15.5:0/918497953 >> v2:172.21.15.112:3300/0 conn(0x7fe7440b6e40 0x7fe744145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.939+0000 7fe743e00640 1 --2- 172.21.15.5:0/918497953 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe744149060 0x7fe74414fe90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e84063161557fc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.939+0000 7fe742a00640 1 -- 172.21.15.5:0/918497953 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c031600 con 0x7fe744149060 2024-04-26T22:04:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.939+0000 7fe742a00640 1 -- 172.21.15.5:0/918497953 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73c0317a0 con 0x7fe744149060 2024-04-26T22:04:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.939+0000 7fe742a00640 1 -- 172.21.15.5:0/918497953 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c031b70 con 0x7fe744149060 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 -- 172.21.15.5:0/918497953 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe744149060 msgr2=0x7fe74414fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 --2- 172.21.15.5:0/918497953 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe744149060 0x7fe74414fe90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c02a5d0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 -- 172.21.15.5:0/918497953 shutdown_connections 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 --2- 172.21.15.5:0/918497953 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe744149060 0x7fe74414fe90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 --2- 172.21.15.5:0/918497953 >> v2:172.21.15.112:3300/0 conn(0x7fe7440b6e40 0x7fe744145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 -- 172.21.15.5:0/918497953 >> 172.21.15.5:0/918497953 conn(0x7fe74406c720 msgr2=0x7fe74406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 -- 172.21.15.5:0/918497953 shutdown_connections 2024-04-26T22:04:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.940+0000 7fe74a200640 1 -- 172.21.15.5:0/918497953 wait complete. 2024-04-26T22:04:18.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.942+0000 7fe74a200640 1 Processor -- start 2024-04-26T22:04:18.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.942+0000 7fe74a200640 1 -- start start 2024-04-26T22:04:18.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.942+0000 7fe74a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7440b0be0 0x7fe744142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.942+0000 7fe74a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7440b6e40 0x7fe7441e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe74a200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe744149060 0x7fe74413be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe74a200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7440b37f0 con 0x7fe7440b6e40 2024-04-26T22:04:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe74a200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7440b6040 con 0x7fe744149060 2024-04-26T22:04:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe74a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe7440b3970 con 0x7fe7440b0be0 2024-04-26T22:04:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7440b6e40 0x7fe7441e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7440b6e40 0x7fe7441e1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34272/0 (socket says 172.21.15.5:34272) 2024-04-26T22:04:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 -- 172.21.15.5:0/286837195 learned_addr learned my addr 172.21.15.5:0/286837195 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe743400640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7440b0be0 0x7fe744142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe743e00640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe744149060 0x7fe74413be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 -- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7440b0be0 msgr2=0x7fe744142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7440b0be0 0x7fe744142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 -- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe744149060 msgr2=0x7fe74413be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe744149060 0x7fe74413be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe73be00640 1 -- 172.21.15.5:0/286837195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe744142a70 con 0x7fe7440b6e40 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.943+0000 7fe743e00640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe744149060 0x7fe74413be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.944+0000 7fe73be00640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7440b6e40 0x7fe7441e1b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c440 tx=0x7fe72c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.944+0000 7fe73b400640 1 -- 172.21.15.5:0/286837195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0052d0 con 0x7fe7440b6e40 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.944+0000 7fe73b400640 1 -- 172.21.15.5:0/286837195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c005470 con 0x7fe7440b6e40 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.944+0000 7fe73b400640 1 -- 172.21.15.5:0/286837195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c007260 con 0x7fe7440b6e40 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.944+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7440b9300 con 0x7fe7440b6e40 2024-04-26T22:04:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.944+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7441413c0 con 0x7fe7440b6e40 2024-04-26T22:04:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.945+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe744075db0 con 0x7fe7440b6e40 2024-04-26T22:04:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.946+0000 7fe73b400640 1 -- 172.21.15.5:0/286837195 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe72c007400 con 0x7fe7440b6e40 2024-04-26T22:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.948+0000 7fe73b400640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe72006c920 0x7fe72006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.948+0000 7fe73b400640 1 -- 172.21.15.5:0/286837195 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe72c08b470 con 0x7fe7440b6e40 2024-04-26T22:04:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.948+0000 7fe743400640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe72006c920 0x7fe72006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.950+0000 7fe743400640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe72006c920 0x7fe72006ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe734009b70 tx=0x7fe734008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:18.953+0000 7fe73b400640 1 -- 172.21.15.5:0/286837195 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe72c059490 con 0x7fe7440b6e40 2024-04-26T22:04:19.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.153+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 --> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7440698f0 con 0x7fe72006c920 2024-04-26T22:04:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.179+0000 7fe73b400640 1 -- 172.21.15.5:0/286837195 <== mgr.4108 v2:172.21.15.112:6832/2672338158 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335648 (secure 0 0 0) 0x7fe734011a60 con 0x7fe72006c920 2024-04-26T22:04:19.185 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:04:19.187 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-26T22:04:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe72006c920 msgr2=0x7fe72006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe72006c920 0x7fe72006ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe734009b70 tx=0x7fe734008040 comp rx=0 tx=0).stop 2024-04-26T22:04:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7440b6e40 msgr2=0x7fe7441e1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7440b6e40 0x7fe7441e1b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c440 tx=0x7fe72c001e70 comp rx=0 tx=0).stop 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 shutdown_connections 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe744149060 0x7fe74413be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe72006c920 0x7fe72006ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7440b6e40 0x7fe7441e1b60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 --2- 172.21.15.5:0/286837195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe7440b0be0 0x7fe744142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 >> 172.21.15.5:0/286837195 conn(0x7fe74406c720 msgr2=0x7fe744143370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 shutdown_connections 2024-04-26T22:04:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.186+0000 7fe74a200640 1 -- 172.21.15.5:0/286837195 wait complete. 2024-04-26T22:04:19.206 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":836,"stamp":"2024-04-26T22:04:18.110593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240755740,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2795,"num_read_kb":5345,"num_write":112477,"num_write_kb":2515076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5447,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156028,"ondisk_log_size":156028,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2516432,"kb_used_data":472464,"kb_used_omap":12,"kb_used_meta":2043891,"kb_avail":752458288,"statfs":{"total":773094113280,"available":770517286912,"internally_reserved":0,"allocated":483803136,"data_stored":482426304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2092944948},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005621"},"pg_stats":[{"pgid":"2.1f","version":"26'1242","reported_seq":1289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:55.667824+0000","last_change":"2024-04-26T22:03:55.667889+0000","last_active":"2024-04-26T22:03:55.667824+0000","last_peered":"2024-04-26T22:03:55.667824+0000","last_clean":"2024-04-26T22:03:55.667824+0000","last_became_active":"2024-04-26T21:37:16.435131+0000","last_became_peered":"2024-04-26T21:37:16.435131+0000","last_unstale":"2024-04-26T22:03:55.667824+0000","last_undegraded":"2024-04-26T22:03:55.667824+0000","last_fullsized":"2024-04-26T22:03:55.667824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1242","last_scrub_stamp":"2024-04-26T22:03:55.667732+0000","last_deep_scrub":"26'1242","last_deep_scrub_stamp":"2024-04-26T22:03:55.667732+0000","last_clean_scrub_stamp":"2024-04-26T22:03:55.667732+0000","objects_scrubbed":2,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:46.438394+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1257,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'475","reported_seq":521,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.704640+0000","last_change":"2024-04-26T22:04:05.704701+0000","last_active":"2024-04-26T22:04:05.704640+0000","last_peered":"2024-04-26T22:04:05.704640+0000","last_clean":"2024-04-26T22:04:05.704640+0000","last_became_active":"2024-04-26T21:37:17.445604+0000","last_became_peered":"2024-04-26T21:37:17.445604+0000","last_unstale":"2024-04-26T22:04:05.704640+0000","last_undegraded":"2024-04-26T22:04:05.704640+0000","last_fullsized":"2024-04-26T22:04:05.704640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'475","last_scrub_stamp":"2024-04-26T22:04:05.704424+0000","last_deep_scrub":"26'475","last_deep_scrub_stamp":"2024-04-26T22:04:05.704424+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.704424+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:56.448917+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'1944","reported_seq":1982,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:09.740407+0000","last_change":"2024-04-26T22:04:09.740477+0000","last_active":"2024-04-26T22:04:09.740407+0000","last_peered":"2024-04-26T22:04:09.740407+0000","last_clean":"2024-04-26T22:04:09.740407+0000","last_became_active":"2024-04-26T21:37:21.486284+0000","last_became_peered":"2024-04-26T21:37:21.486284+0000","last_unstale":"2024-04-26T22:04:09.740407+0000","last_undegraded":"2024-04-26T22:04:09.740407+0000","last_fullsized":"2024-04-26T22:04:09.740407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1944","last_scrub_stamp":"2024-04-26T22:04:09.740217+0000","last_deep_scrub":"26'1944","last_deep_scrub_stamp":"2024-04-26T22:04:09.740217+0000","last_clean_scrub_stamp":"2024-04-26T22:04:09.740217+0000","objects_scrubbed":0,"log_size":1944,"log_dups_size":0,"ondisk_log_size":1944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:36.352939+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":38072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'3193","reported_seq":3241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.765729+0000","last_change":"2024-04-26T22:03:59.765792+0000","last_active":"2024-04-26T22:03:59.765729+0000","last_peered":"2024-04-26T22:03:59.765729+0000","last_clean":"2024-04-26T22:03:59.765729+0000","last_became_active":"2024-04-26T21:37:16.425548+0000","last_became_peered":"2024-04-26T21:37:16.425548+0000","last_unstale":"2024-04-26T22:03:59.765729+0000","last_undegraded":"2024-04-26T22:03:59.765729+0000","last_fullsized":"2024-04-26T22:03:59.765729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3193","last_scrub_stamp":"2024-04-26T22:03:59.765603+0000","last_deep_scrub":"26'3193","last_deep_scrub_stamp":"2024-04-26T22:03:59.765603+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.765603+0000","objects_scrubbed":5,"log_size":3193,"log_dups_size":0,"ondisk_log_size":3193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:35.388276+0000","scrub_duration":114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3196,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'472","reported_seq":517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:04.712525+0000","last_change":"2024-04-26T22:04:04.712678+0000","last_active":"2024-04-26T22:04:04.712525+0000","last_peered":"2024-04-26T22:04:04.712525+0000","last_clean":"2024-04-26T22:04:04.712525+0000","last_became_active":"2024-04-26T21:37:17.455777+0000","last_became_peered":"2024-04-26T21:37:17.455777+0000","last_unstale":"2024-04-26T22:04:04.712525+0000","last_undegraded":"2024-04-26T22:04:04.712525+0000","last_fullsized":"2024-04-26T22:04:04.712525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'472","last_scrub_stamp":"2024-04-26T22:04:04.712321+0000","last_deep_scrub":"26'472","last_deep_scrub_stamp":"2024-04-26T22:04:04.712321+0000","last_clean_scrub_stamp":"2024-04-26T22:04:04.712321+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:59:52.101869+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2092","reported_seq":2130,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:04.495269+0000","last_change":"2024-04-26T22:04:04.495332+0000","last_active":"2024-04-26T22:04:04.495269+0000","last_peered":"2024-04-26T22:04:04.495269+0000","last_clean":"2024-04-26T22:04:04.495269+0000","last_became_active":"2024-04-26T21:37:21.497929+0000","last_became_peered":"2024-04-26T21:37:21.497929+0000","last_unstale":"2024-04-26T22:04:04.495269+0000","last_undegraded":"2024-04-26T22:04:04.495269+0000","last_fullsized":"2024-04-26T22:04:04.495269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2092","last_scrub_stamp":"2024-04-26T22:04:04.495086+0000","last_deep_scrub":"26'2092","last_deep_scrub_stamp":"2024-04-26T22:04:04.495086+0000","last_clean_scrub_stamp":"2024-04-26T22:04:04.495086+0000","objects_scrubbed":0,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:36.775421+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":42136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'3686","reported_seq":3731,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.581943+0000","last_change":"2024-04-26T22:04:05.582002+0000","last_active":"2024-04-26T22:04:05.581943+0000","last_peered":"2024-04-26T22:04:05.581943+0000","last_clean":"2024-04-26T22:04:05.581943+0000","last_became_active":"2024-04-26T21:37:16.448634+0000","last_became_peered":"2024-04-26T21:37:16.448634+0000","last_unstale":"2024-04-26T22:04:05.581943+0000","last_undegraded":"2024-04-26T22:04:05.581943+0000","last_fullsized":"2024-04-26T22:04:05.581943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3686","last_scrub_stamp":"2024-04-26T22:04:05.581788+0000","last_deep_scrub":"26'3686","last_deep_scrub_stamp":"2024-04-26T22:04:05.581788+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.581788+0000","objects_scrubbed":5,"log_size":3686,"log_dups_size":0,"ondisk_log_size":3686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:29.345777+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3687,"num_write_kb":30415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'531","reported_seq":574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.007597+0000","last_change":"2024-04-26T22:04:05.007659+0000","last_active":"2024-04-26T22:04:05.007597+0000","last_peered":"2024-04-26T22:04:05.007597+0000","last_clean":"2024-04-26T22:04:05.007597+0000","last_became_active":"2024-04-26T21:37:17.444235+0000","last_became_peered":"2024-04-26T21:37:17.444235+0000","last_unstale":"2024-04-26T22:04:05.007597+0000","last_undegraded":"2024-04-26T22:04:05.007597+0000","last_fullsized":"2024-04-26T22:04:05.007597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'531","last_scrub_stamp":"2024-04-26T22:04:05.007428+0000","last_deep_scrub":"26'531","last_deep_scrub_stamp":"2024-04-26T22:04:05.007428+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.007428+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:37.756145+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'2113","reported_seq":2157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:10.468182+0000","last_change":"2024-04-26T22:04:10.468247+0000","last_active":"2024-04-26T22:04:10.468182+0000","last_peered":"2024-04-26T22:04:10.468182+0000","last_clean":"2024-04-26T22:04:10.468182+0000","last_became_active":"2024-04-26T21:37:58.754696+0000","last_became_peered":"2024-04-26T21:37:58.754696+0000","last_unstale":"2024-04-26T22:04:10.468182+0000","last_undegraded":"2024-04-26T22:04:10.468182+0000","last_fullsized":"2024-04-26T22:04:10.468182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2113","last_scrub_stamp":"2024-04-26T22:04:10.467992+0000","last_deep_scrub":"26'2113","last_deep_scrub_stamp":"2024-04-26T22:04:10.467992+0000","last_clean_scrub_stamp":"2024-04-26T22:04:10.467992+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:13.985627+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1612,"num_write_kb":85113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'412","reported_seq":457,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.434036+0000","last_change":"2024-04-26T22:04:03.434103+0000","last_active":"2024-04-26T22:04:03.434036+0000","last_peered":"2024-04-26T22:04:03.434036+0000","last_clean":"2024-04-26T22:04:03.434036+0000","last_became_active":"2024-04-26T21:37:16.443683+0000","last_became_peered":"2024-04-26T21:37:16.443683+0000","last_unstale":"2024-04-26T22:04:03.434036+0000","last_undegraded":"2024-04-26T22:04:03.434036+0000","last_fullsized":"2024-04-26T22:04:03.434036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'412","last_scrub_stamp":"2024-04-26T22:04:03.433847+0000","last_deep_scrub":"26'412","last_deep_scrub_stamp":"2024-04-26T22:04:03.433847+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.433847+0000","objects_scrubbed":1,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:39.056520+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'485","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.999858+0000","last_change":"2024-04-26T22:04:05.999961+0000","last_active":"2024-04-26T22:04:05.999858+0000","last_peered":"2024-04-26T22:04:05.999858+0000","last_clean":"2024-04-26T22:04:05.999858+0000","last_became_active":"2024-04-26T21:37:17.448807+0000","last_became_peered":"2024-04-26T21:37:17.448807+0000","last_unstale":"2024-04-26T22:04:05.999858+0000","last_undegraded":"2024-04-26T22:04:05.999858+0000","last_fullsized":"2024-04-26T22:04:05.999858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'485","last_scrub_stamp":"2024-04-26T22:04:05.999685+0000","last_deep_scrub":"26'485","last_deep_scrub_stamp":"2024-04-26T22:04:05.999685+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.999685+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:54.779000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'2117","reported_seq":2154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.473791+0000","last_change":"2024-04-26T22:04:07.473941+0000","last_active":"2024-04-26T22:04:07.473791+0000","last_peered":"2024-04-26T22:04:07.473791+0000","last_clean":"2024-04-26T22:04:07.473791+0000","last_became_active":"2024-04-26T21:37:21.500247+0000","last_became_peered":"2024-04-26T21:37:21.500247+0000","last_unstale":"2024-04-26T22:04:07.473791+0000","last_undegraded":"2024-04-26T22:04:07.473791+0000","last_fullsized":"2024-04-26T22:04:07.473791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2117","last_scrub_stamp":"2024-04-26T22:04:07.473564+0000","last_deep_scrub":"26'2117","last_deep_scrub_stamp":"2024-04-26T22:04:07.473564+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.473564+0000","objects_scrubbed":0,"log_size":2117,"log_dups_size":0,"ondisk_log_size":2117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:44.624017+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1631,"num_write_kb":60261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'502","reported_seq":547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.305602+0000","last_change":"2024-04-26T22:04:07.305665+0000","last_active":"2024-04-26T22:04:07.305602+0000","last_peered":"2024-04-26T22:04:07.305602+0000","last_clean":"2024-04-26T22:04:07.305602+0000","last_became_active":"2024-04-26T21:37:17.457040+0000","last_became_peered":"2024-04-26T21:37:17.457040+0000","last_unstale":"2024-04-26T22:04:07.305602+0000","last_undegraded":"2024-04-26T22:04:07.305602+0000","last_fullsized":"2024-04-26T22:04:07.305602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'502","last_scrub_stamp":"2024-04-26T22:04:07.305436+0000","last_deep_scrub":"26'502","last_deep_scrub_stamp":"2024-04-26T22:04:07.305436+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.305436+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:26.841538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'2425","reported_seq":2471,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.520475+0000","last_change":"2024-04-26T22:04:02.520543+0000","last_active":"2024-04-26T22:04:02.520475+0000","last_peered":"2024-04-26T22:04:02.520475+0000","last_clean":"2024-04-26T22:04:02.520475+0000","last_became_active":"2024-04-26T21:37:16.441887+0000","last_became_peered":"2024-04-26T21:37:16.441887+0000","last_unstale":"2024-04-26T22:04:02.520475+0000","last_undegraded":"2024-04-26T22:04:02.520475+0000","last_fullsized":"2024-04-26T22:04:02.520475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2425","last_scrub_stamp":"2024-04-26T22:04:02.520316+0000","last_deep_scrub":"26'2425","last_deep_scrub_stamp":"2024-04-26T22:04:02.520316+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.520316+0000","objects_scrubbed":4,"log_size":2425,"log_dups_size":0,"ondisk_log_size":2425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:10.040395+0000","scrub_duration":85,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":21667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'2164","reported_seq":2202,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.466164+0000","last_change":"2024-04-26T22:04:02.466236+0000","last_active":"2024-04-26T22:04:02.466164+0000","last_peered":"2024-04-26T22:04:02.466164+0000","last_clean":"2024-04-26T22:04:02.466164+0000","last_became_active":"2024-04-26T21:37:21.491632+0000","last_became_peered":"2024-04-26T21:37:21.491632+0000","last_unstale":"2024-04-26T22:04:02.466164+0000","last_undegraded":"2024-04-26T22:04:02.466164+0000","last_fullsized":"2024-04-26T22:04:02.466164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2164","last_scrub_stamp":"2024-04-26T22:04:02.465832+0000","last_deep_scrub":"26'2164","last_deep_scrub_stamp":"2024-04-26T22:04:02.465832+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.465832+0000","objects_scrubbed":0,"log_size":2164,"log_dups_size":0,"ondisk_log_size":2164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:09.985911+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1702,"num_write_kb":82391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'487","reported_seq":531,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:55.770661+0000","last_change":"2024-04-26T22:03:55.770706+0000","last_active":"2024-04-26T22:03:55.770661+0000","last_peered":"2024-04-26T22:03:55.770661+0000","last_clean":"2024-04-26T22:03:55.770661+0000","last_became_active":"2024-04-26T21:37:17.450262+0000","last_became_peered":"2024-04-26T21:37:17.450262+0000","last_unstale":"2024-04-26T22:03:55.770661+0000","last_undegraded":"2024-04-26T22:03:55.770661+0000","last_fullsized":"2024-04-26T22:03:55.770661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'487","last_scrub_stamp":"2024-04-26T22:03:55.770534+0000","last_deep_scrub":"26'487","last_deep_scrub_stamp":"2024-04-26T22:03:55.770534+0000","last_clean_scrub_stamp":"2024-04-26T22:03:55.770534+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:28.094959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'2550","reported_seq":2597,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:57.036948+0000","last_change":"2024-04-26T22:03:57.036985+0000","last_active":"2024-04-26T22:03:57.036948+0000","last_peered":"2024-04-26T22:03:57.036948+0000","last_clean":"2024-04-26T22:03:57.036948+0000","last_became_active":"2024-04-26T21:37:16.434327+0000","last_became_peered":"2024-04-26T21:37:16.434327+0000","last_unstale":"2024-04-26T22:03:57.036948+0000","last_undegraded":"2024-04-26T22:03:57.036948+0000","last_fullsized":"2024-04-26T22:03:57.036948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2550","last_scrub_stamp":"2024-04-26T22:03:57.036878+0000","last_deep_scrub":"26'2550","last_deep_scrub_stamp":"2024-04-26T22:03:57.036878+0000","last_clean_scrub_stamp":"2024-04-26T22:03:57.036878+0000","objects_scrubbed":4,"log_size":2550,"log_dups_size":0,"ondisk_log_size":2550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:23:35.289192+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2556,"num_write_kb":21644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'2346","reported_seq":2384,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:08.500724+0000","last_change":"2024-04-26T22:04:08.500851+0000","last_active":"2024-04-26T22:04:08.500724+0000","last_peered":"2024-04-26T22:04:08.500724+0000","last_clean":"2024-04-26T22:04:08.500724+0000","last_became_active":"2024-04-26T21:37:21.507110+0000","last_became_peered":"2024-04-26T21:37:21.507110+0000","last_unstale":"2024-04-26T22:04:08.500724+0000","last_undegraded":"2024-04-26T22:04:08.500724+0000","last_fullsized":"2024-04-26T22:04:08.500724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2346","last_scrub_stamp":"2024-04-26T22:04:08.500466+0000","last_deep_scrub":"26'2346","last_deep_scrub_stamp":"2024-04-26T22:04:08.500466+0000","last_clean_scrub_stamp":"2024-04-26T22:04:08.500466+0000","objects_scrubbed":0,"log_size":2346,"log_dups_size":0,"ondisk_log_size":2346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:43.382706+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1850,"num_write_kb":43022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'518","reported_seq":563,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:56.735093+0000","last_change":"2024-04-26T22:03:56.735149+0000","last_active":"2024-04-26T22:03:56.735093+0000","last_peered":"2024-04-26T22:03:56.735093+0000","last_clean":"2024-04-26T22:03:56.735093+0000","last_became_active":"2024-04-26T21:37:17.448348+0000","last_became_peered":"2024-04-26T21:37:17.448348+0000","last_unstale":"2024-04-26T22:03:56.735093+0000","last_undegraded":"2024-04-26T22:03:56.735093+0000","last_fullsized":"2024-04-26T22:03:56.735093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'518","last_scrub_stamp":"2024-04-26T22:03:56.734925+0000","last_deep_scrub":"26'518","last_deep_scrub_stamp":"2024-04-26T22:03:56.734925+0000","last_clean_scrub_stamp":"2024-04-26T22:03:56.734925+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:14.222147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'926","reported_seq":973,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.065104+0000","last_change":"2024-04-26T22:03:59.065169+0000","last_active":"2024-04-26T22:03:59.065104+0000","last_peered":"2024-04-26T22:03:59.065104+0000","last_clean":"2024-04-26T22:03:59.065104+0000","last_became_active":"2024-04-26T21:37:16.436447+0000","last_became_peered":"2024-04-26T21:37:16.436447+0000","last_unstale":"2024-04-26T22:03:59.065104+0000","last_undegraded":"2024-04-26T22:03:59.065104+0000","last_fullsized":"2024-04-26T22:03:59.065104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'926","last_scrub_stamp":"2024-04-26T22:03:59.064921+0000","last_deep_scrub":"26'926","last_deep_scrub_stamp":"2024-04-26T22:03:59.064921+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.064921+0000","objects_scrubbed":1,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:06.585000+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":8623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'2213","reported_seq":2251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:08.216098+0000","last_change":"2024-04-26T22:04:08.216163+0000","last_active":"2024-04-26T22:04:08.216098+0000","last_peered":"2024-04-26T22:04:08.216098+0000","last_clean":"2024-04-26T22:04:08.216098+0000","last_became_active":"2024-04-26T21:37:21.498959+0000","last_became_peered":"2024-04-26T21:37:21.498959+0000","last_unstale":"2024-04-26T22:04:08.216098+0000","last_undegraded":"2024-04-26T22:04:08.216098+0000","last_fullsized":"2024-04-26T22:04:08.216098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2213","last_scrub_stamp":"2024-04-26T22:04:08.215912+0000","last_deep_scrub":"26'2213","last_deep_scrub_stamp":"2024-04-26T22:04:08.215912+0000","last_clean_scrub_stamp":"2024-04-26T22:04:08.215912+0000","objects_scrubbed":0,"log_size":2213,"log_dups_size":0,"ondisk_log_size":2213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:23.274068+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":80555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'512","reported_seq":557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.427131+0000","last_change":"2024-04-26T22:04:00.427190+0000","last_active":"2024-04-26T22:04:00.427131+0000","last_peered":"2024-04-26T22:04:00.427131+0000","last_clean":"2024-04-26T22:04:00.427131+0000","last_became_active":"2024-04-26T21:37:17.439463+0000","last_became_peered":"2024-04-26T21:37:17.439463+0000","last_unstale":"2024-04-26T22:04:00.427131+0000","last_undegraded":"2024-04-26T22:04:00.427131+0000","last_fullsized":"2024-04-26T22:04:00.427131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'512","last_scrub_stamp":"2024-04-26T22:04:00.426955+0000","last_deep_scrub":"26'512","last_deep_scrub_stamp":"2024-04-26T22:04:00.426955+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.426955+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:23:38.679268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'481","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.449929+0000","last_change":"2024-04-26T22:04:01.449990+0000","last_active":"2024-04-26T22:04:01.449929+0000","last_peered":"2024-04-26T22:04:01.449929+0000","last_clean":"2024-04-26T22:04:01.449929+0000","last_became_active":"2024-04-26T21:37:16.437890+0000","last_became_peered":"2024-04-26T21:37:16.437890+0000","last_unstale":"2024-04-26T22:04:01.449929+0000","last_undegraded":"2024-04-26T22:04:01.449929+0000","last_fullsized":"2024-04-26T22:04:01.449929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'481","last_scrub_stamp":"2024-04-26T22:04:01.449718+0000","last_deep_scrub":"26'481","last_deep_scrub_stamp":"2024-04-26T22:04:01.449718+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.449718+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:06.957591+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'1921","reported_seq":1959,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:06.454795+0000","last_change":"2024-04-26T22:04:06.454859+0000","last_active":"2024-04-26T22:04:06.454795+0000","last_peered":"2024-04-26T22:04:06.454795+0000","last_clean":"2024-04-26T22:04:06.454795+0000","last_became_active":"2024-04-26T21:37:21.499985+0000","last_became_peered":"2024-04-26T21:37:21.499985+0000","last_unstale":"2024-04-26T22:04:06.454795+0000","last_undegraded":"2024-04-26T22:04:06.454795+0000","last_fullsized":"2024-04-26T22:04:06.454795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1921","last_scrub_stamp":"2024-04-26T22:04:06.454610+0000","last_deep_scrub":"26'1921","last_deep_scrub_stamp":"2024-04-26T22:04:06.454610+0000","last_clean_scrub_stamp":"2024-04-26T22:04:06.454610+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:23.332750+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'497","reported_seq":542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.707664+0000","last_change":"2024-04-26T22:04:00.707728+0000","last_active":"2024-04-26T22:04:00.707664+0000","last_peered":"2024-04-26T22:04:00.707664+0000","last_clean":"2024-04-26T22:04:00.707664+0000","last_became_active":"2024-04-26T21:37:17.438822+0000","last_became_peered":"2024-04-26T21:37:17.438822+0000","last_unstale":"2024-04-26T22:04:00.707664+0000","last_undegraded":"2024-04-26T22:04:00.707664+0000","last_fullsized":"2024-04-26T22:04:00.707664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'497","last_scrub_stamp":"2024-04-26T22:04:00.707456+0000","last_deep_scrub":"26'497","last_deep_scrub_stamp":"2024-04-26T22:04:00.707456+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.707456+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:57.309606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'398","reported_seq":445,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.338808+0000","last_change":"2024-04-26T22:04:02.338914+0000","last_active":"2024-04-26T22:04:02.338808+0000","last_peered":"2024-04-26T22:04:02.338808+0000","last_clean":"2024-04-26T22:04:02.338808+0000","last_became_active":"2024-04-26T21:37:16.444902+0000","last_became_peered":"2024-04-26T21:37:16.444902+0000","last_unstale":"2024-04-26T22:04:02.338808+0000","last_undegraded":"2024-04-26T22:04:02.338808+0000","last_fullsized":"2024-04-26T22:04:02.338808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'398","last_scrub_stamp":"2024-04-26T22:04:02.338626+0000","last_deep_scrub":"26'398","last_deep_scrub_stamp":"2024-04-26T22:04:02.338626+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.338626+0000","objects_scrubbed":1,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:34.663051+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'2230","reported_seq":2269,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.459789+0000","last_change":"2024-04-26T22:04:03.459857+0000","last_active":"2024-04-26T22:04:03.459789+0000","last_peered":"2024-04-26T22:04:03.459789+0000","last_clean":"2024-04-26T22:04:03.459789+0000","last_became_active":"2024-04-26T21:37:21.494600+0000","last_became_peered":"2024-04-26T21:37:21.494600+0000","last_unstale":"2024-04-26T22:04:03.459789+0000","last_undegraded":"2024-04-26T22:04:03.459789+0000","last_fullsized":"2024-04-26T22:04:03.459789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2230","last_scrub_stamp":"2024-04-26T22:04:03.459535+0000","last_deep_scrub":"26'2230","last_deep_scrub_stamp":"2024-04-26T22:04:03.459535+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.459535+0000","objects_scrubbed":0,"log_size":2230,"log_dups_size":0,"ondisk_log_size":2230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:00.061686+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1721,"num_write_kb":137897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'453","reported_seq":498,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.673792+0000","last_change":"2024-04-26T22:04:02.673909+0000","last_active":"2024-04-26T22:04:02.673792+0000","last_peered":"2024-04-26T22:04:02.673792+0000","last_clean":"2024-04-26T22:04:02.673792+0000","last_became_active":"2024-04-26T21:37:17.427104+0000","last_became_peered":"2024-04-26T21:37:17.427104+0000","last_unstale":"2024-04-26T22:04:02.673792+0000","last_undegraded":"2024-04-26T22:04:02.673792+0000","last_fullsized":"2024-04-26T22:04:02.673792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'453","last_scrub_stamp":"2024-04-26T22:04:02.673490+0000","last_deep_scrub":"26'453","last_deep_scrub_stamp":"2024-04-26T22:04:02.673490+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.673490+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:19.551629+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1575","reported_seq":1622,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.108202+0000","last_change":"2024-04-26T22:04:01.108270+0000","last_active":"2024-04-26T22:04:01.108202+0000","last_peered":"2024-04-26T22:04:01.108202+0000","last_clean":"2024-04-26T22:04:01.108202+0000","last_became_active":"2024-04-26T21:37:16.442653+0000","last_became_peered":"2024-04-26T21:37:16.442653+0000","last_unstale":"2024-04-26T22:04:01.108202+0000","last_undegraded":"2024-04-26T22:04:01.108202+0000","last_fullsized":"2024-04-26T22:04:01.108202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1575","last_scrub_stamp":"2024-04-26T22:04:01.108029+0000","last_deep_scrub":"26'1575","last_deep_scrub_stamp":"2024-04-26T22:04:01.108029+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.108029+0000","objects_scrubbed":2,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:33.388364+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903801,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4315,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'1970","reported_seq":2010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:10.728998+0000","last_change":"2024-04-26T22:04:10.729119+0000","last_active":"2024-04-26T22:04:10.728998+0000","last_peered":"2024-04-26T22:04:10.728998+0000","last_clean":"2024-04-26T22:04:10.728998+0000","last_became_active":"2024-04-26T21:37:21.490284+0000","last_became_peered":"2024-04-26T21:37:21.490284+0000","last_unstale":"2024-04-26T22:04:10.728998+0000","last_undegraded":"2024-04-26T22:04:10.728998+0000","last_fullsized":"2024-04-26T22:04:10.728998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1970","last_scrub_stamp":"2024-04-26T22:04:10.728703+0000","last_deep_scrub":"26'1970","last_deep_scrub_stamp":"2024-04-26T22:04:10.728703+0000","last_clean_scrub_stamp":"2024-04-26T22:04:10.728703+0000","objects_scrubbed":0,"log_size":1970,"log_dups_size":0,"ondisk_log_size":1970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:27.214808+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":39987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'506","reported_seq":551,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:04.157094+0000","last_change":"2024-04-26T22:04:04.157159+0000","last_active":"2024-04-26T22:04:04.157094+0000","last_peered":"2024-04-26T22:04:04.157094+0000","last_clean":"2024-04-26T22:04:04.157094+0000","last_became_active":"2024-04-26T21:37:17.435596+0000","last_became_peered":"2024-04-26T21:37:17.435596+0000","last_unstale":"2024-04-26T22:04:04.157094+0000","last_undegraded":"2024-04-26T22:04:04.157094+0000","last_fullsized":"2024-04-26T22:04:04.157094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'506","last_scrub_stamp":"2024-04-26T22:04:04.156902+0000","last_deep_scrub":"26'506","last_deep_scrub_stamp":"2024-04-26T22:04:04.156902+0000","last_clean_scrub_stamp":"2024-04-26T22:04:04.156902+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:41.307354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2121","reported_seq":2168,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:04.485463+0000","last_change":"2024-04-26T22:04:04.485592+0000","last_active":"2024-04-26T22:04:04.485463+0000","last_peered":"2024-04-26T22:04:04.485463+0000","last_clean":"2024-04-26T22:04:04.485463+0000","last_became_active":"2024-04-26T21:37:16.445605+0000","last_became_peered":"2024-04-26T21:37:16.445605+0000","last_unstale":"2024-04-26T22:04:04.485463+0000","last_undegraded":"2024-04-26T22:04:04.485463+0000","last_fullsized":"2024-04-26T22:04:04.485463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2121","last_scrub_stamp":"2024-04-26T22:04:04.485265+0000","last_deep_scrub":"26'2121","last_deep_scrub_stamp":"2024-04-26T22:04:04.485265+0000","last_clean_scrub_stamp":"2024-04-26T22:04:04.485265+0000","objects_scrubbed":2,"log_size":2121,"log_dups_size":0,"ondisk_log_size":2121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:24.021367+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2125,"num_write_kb":17294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2154","reported_seq":2193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:06.702997+0000","last_change":"2024-04-26T22:04:06.703061+0000","last_active":"2024-04-26T22:04:06.702997+0000","last_peered":"2024-04-26T22:04:06.702997+0000","last_clean":"2024-04-26T22:04:06.702997+0000","last_became_active":"2024-04-26T21:37:21.497072+0000","last_became_peered":"2024-04-26T21:37:21.497072+0000","last_unstale":"2024-04-26T22:04:06.702997+0000","last_undegraded":"2024-04-26T22:04:06.702997+0000","last_fullsized":"2024-04-26T22:04:06.702997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2154","last_scrub_stamp":"2024-04-26T22:04:06.702817+0000","last_deep_scrub":"26'2154","last_deep_scrub_stamp":"2024-04-26T22:04:06.702817+0000","last_clean_scrub_stamp":"2024-04-26T22:04:06.702817+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:57.447310+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1661,"num_write_kb":51179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'504","reported_seq":549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:09.977386+0000","last_change":"2024-04-26T22:04:09.977446+0000","last_active":"2024-04-26T22:04:09.977386+0000","last_peered":"2024-04-26T22:04:09.977386+0000","last_clean":"2024-04-26T22:04:09.977386+0000","last_became_active":"2024-04-26T21:37:17.451112+0000","last_became_peered":"2024-04-26T21:37:17.451112+0000","last_unstale":"2024-04-26T22:04:09.977386+0000","last_undegraded":"2024-04-26T22:04:09.977386+0000","last_fullsized":"2024-04-26T22:04:09.977386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'504","last_scrub_stamp":"2024-04-26T22:04:09.977189+0000","last_deep_scrub":"26'504","last_deep_scrub_stamp":"2024-04-26T22:04:09.977189+0000","last_clean_scrub_stamp":"2024-04-26T22:04:09.977189+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:13.494825+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'363","reported_seq":410,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:56.000816+0000","last_change":"2024-04-26T22:03:56.000860+0000","last_active":"2024-04-26T22:03:56.000816+0000","last_peered":"2024-04-26T22:03:56.000816+0000","last_clean":"2024-04-26T22:03:56.000816+0000","last_became_active":"2024-04-26T21:37:16.429961+0000","last_became_peered":"2024-04-26T21:37:16.429961+0000","last_unstale":"2024-04-26T22:03:56.000816+0000","last_undegraded":"2024-04-26T22:03:56.000816+0000","last_fullsized":"2024-04-26T22:03:56.000816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'363","last_scrub_stamp":"2024-04-26T22:03:56.000705+0000","last_deep_scrub":"26'363","last_deep_scrub_stamp":"2024-04-26T22:03:56.000705+0000","last_clean_scrub_stamp":"2024-04-26T22:03:56.000705+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:39.941413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'2388","reported_seq":2427,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.240468+0000","last_change":"2024-04-26T22:04:07.240531+0000","last_active":"2024-04-26T22:04:07.240468+0000","last_peered":"2024-04-26T22:04:07.240468+0000","last_clean":"2024-04-26T22:04:07.240468+0000","last_became_active":"2024-04-26T21:37:21.498113+0000","last_became_peered":"2024-04-26T21:37:21.498113+0000","last_unstale":"2024-04-26T22:04:07.240468+0000","last_undegraded":"2024-04-26T22:04:07.240468+0000","last_fullsized":"2024-04-26T22:04:07.240468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2388","last_scrub_stamp":"2024-04-26T22:04:07.240276+0000","last_deep_scrub":"26'2388","last_deep_scrub_stamp":"2024-04-26T22:04:07.240276+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.240276+0000","objects_scrubbed":0,"log_size":2388,"log_dups_size":0,"ondisk_log_size":2388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:10.757912+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":100197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'512","reported_seq":557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.435740+0000","last_change":"2024-04-26T22:03:58.435858+0000","last_active":"2024-04-26T22:03:58.435740+0000","last_peered":"2024-04-26T22:03:58.435740+0000","last_clean":"2024-04-26T22:03:58.435740+0000","last_became_active":"2024-04-26T21:37:17.427212+0000","last_became_peered":"2024-04-26T21:37:17.427212+0000","last_unstale":"2024-04-26T22:03:58.435740+0000","last_undegraded":"2024-04-26T22:03:58.435740+0000","last_fullsized":"2024-04-26T22:03:58.435740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'512","last_scrub_stamp":"2024-04-26T22:03:58.435543+0000","last_deep_scrub":"26'512","last_deep_scrub_stamp":"2024-04-26T22:03:58.435543+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.435543+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:49.206204+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'2501","reported_seq":2548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.975110+0000","last_change":"2024-04-26T22:04:00.975192+0000","last_active":"2024-04-26T22:04:00.975110+0000","last_peered":"2024-04-26T22:04:00.975110+0000","last_clean":"2024-04-26T22:04:00.975110+0000","last_became_active":"2024-04-26T21:37:16.437296+0000","last_became_peered":"2024-04-26T21:37:16.437296+0000","last_unstale":"2024-04-26T22:04:00.975110+0000","last_undegraded":"2024-04-26T22:04:00.975110+0000","last_fullsized":"2024-04-26T22:04:00.975110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2501","last_scrub_stamp":"2024-04-26T22:04:00.974917+0000","last_deep_scrub":"26'2501","last_deep_scrub_stamp":"2024-04-26T22:04:00.974917+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.974917+0000","objects_scrubbed":3,"log_size":2501,"log_dups_size":0,"ondisk_log_size":2501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:06.482790+0000","scrub_duration":76,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2501,"num_write_kb":21681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2296","reported_seq":2335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:09.238739+0000","last_change":"2024-04-26T22:04:09.238803+0000","last_active":"2024-04-26T22:04:09.238739+0000","last_peered":"2024-04-26T22:04:09.238739+0000","last_clean":"2024-04-26T22:04:09.238739+0000","last_became_active":"2024-04-26T21:37:21.501674+0000","last_became_peered":"2024-04-26T21:37:21.501674+0000","last_unstale":"2024-04-26T22:04:09.238739+0000","last_undegraded":"2024-04-26T22:04:09.238739+0000","last_fullsized":"2024-04-26T22:04:09.238739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2296","last_scrub_stamp":"2024-04-26T22:04:09.238512+0000","last_deep_scrub":"26'2296","last_deep_scrub_stamp":"2024-04-26T22:04:09.238512+0000","last_clean_scrub_stamp":"2024-04-26T22:04:09.238512+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:28.195879+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1815,"num_write_kb":51574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'506","reported_seq":552,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:54.966346+0000","last_change":"2024-04-26T22:03:54.966404+0000","last_active":"2024-04-26T22:03:54.966346+0000","last_peered":"2024-04-26T22:03:54.966346+0000","last_clean":"2024-04-26T22:03:54.966346+0000","last_became_active":"2024-04-26T21:37:17.433872+0000","last_became_peered":"2024-04-26T21:37:17.433872+0000","last_unstale":"2024-04-26T22:03:54.966346+0000","last_undegraded":"2024-04-26T22:03:54.966346+0000","last_fullsized":"2024-04-26T22:03:54.966346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'506","last_scrub_stamp":"2024-04-26T22:03:54.966162+0000","last_deep_scrub":"26'506","last_deep_scrub_stamp":"2024-04-26T22:03:54.966162+0000","last_clean_scrub_stamp":"2024-04-26T22:03:54.966162+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:45.736823+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4046","reported_seq":6772,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:55.672398+0000","last_change":"2024-04-26T22:03:55.672440+0000","last_active":"2024-04-26T22:03:55.672398+0000","last_peered":"2024-04-26T22:03:55.672398+0000","last_clean":"2024-04-26T22:03:55.672398+0000","last_became_active":"2024-04-26T21:37:16.419563+0000","last_became_peered":"2024-04-26T21:37:16.419563+0000","last_unstale":"2024-04-26T22:03:55.672398+0000","last_undegraded":"2024-04-26T22:03:55.672398+0000","last_fullsized":"2024-04-26T22:03:55.672398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4046","last_scrub_stamp":"2024-04-26T22:03:55.672316+0000","last_deep_scrub":"26'4046","last_deep_scrub_stamp":"2024-04-26T22:03:55.672316+0000","last_clean_scrub_stamp":"2024-04-26T22:03:55.672316+0000","objects_scrubbed":4,"log_size":4046,"log_dups_size":0,"ondisk_log_size":4046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:54.037517+0000","scrub_duration":66,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15961989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":4049,"num_write_kb":18210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'1988","reported_seq":2027,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:06.195622+0000","last_change":"2024-04-26T22:04:06.195695+0000","last_active":"2024-04-26T22:04:06.195622+0000","last_peered":"2024-04-26T22:04:06.195622+0000","last_clean":"2024-04-26T22:04:06.195622+0000","last_became_active":"2024-04-26T21:37:21.488658+0000","last_became_peered":"2024-04-26T21:37:21.488658+0000","last_unstale":"2024-04-26T22:04:06.195622+0000","last_undegraded":"2024-04-26T22:04:06.195622+0000","last_fullsized":"2024-04-26T22:04:06.195622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1988","last_scrub_stamp":"2024-04-26T22:04:06.195396+0000","last_deep_scrub":"26'1988","last_deep_scrub_stamp":"2024-04-26T22:04:06.195396+0000","last_clean_scrub_stamp":"2024-04-26T22:04:06.195396+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:41.600772+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1509,"num_write_kb":88301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'487","reported_seq":532,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:56.661106+0000","last_change":"2024-04-26T22:03:56.661148+0000","last_active":"2024-04-26T22:03:56.661106+0000","last_peered":"2024-04-26T22:03:56.661106+0000","last_clean":"2024-04-26T22:03:56.661106+0000","last_became_active":"2024-04-26T21:37:17.424153+0000","last_became_peered":"2024-04-26T21:37:17.424153+0000","last_unstale":"2024-04-26T22:03:56.661106+0000","last_undegraded":"2024-04-26T22:03:56.661106+0000","last_fullsized":"2024-04-26T22:03:56.661106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'487","last_scrub_stamp":"2024-04-26T22:03:56.661005+0000","last_deep_scrub":"26'487","last_deep_scrub_stamp":"2024-04-26T22:03:56.661005+0000","last_clean_scrub_stamp":"2024-04-26T22:03:56.661005+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:40.601713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'2391","reported_seq":2439,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.499971+0000","last_change":"2024-04-26T22:04:00.500038+0000","last_active":"2024-04-26T22:04:00.499971+0000","last_peered":"2024-04-26T22:04:00.499971+0000","last_clean":"2024-04-26T22:04:00.499971+0000","last_became_active":"2024-04-26T21:37:16.437093+0000","last_became_peered":"2024-04-26T21:37:16.437093+0000","last_unstale":"2024-04-26T22:04:00.499971+0000","last_undegraded":"2024-04-26T22:04:00.499971+0000","last_fullsized":"2024-04-26T22:04:00.499971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2391","last_scrub_stamp":"2024-04-26T22:04:00.499773+0000","last_deep_scrub":"26'2391","last_deep_scrub_stamp":"2024-04-26T22:04:00.499773+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.499773+0000","objects_scrubbed":1,"log_size":2391,"log_dups_size":0,"ondisk_log_size":2391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:23:38.752086+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2392,"num_write_kb":17555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'2202","reported_seq":2241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:09.776805+0000","last_change":"2024-04-26T22:04:09.776868+0000","last_active":"2024-04-26T22:04:09.776805+0000","last_peered":"2024-04-26T22:04:09.776805+0000","last_clean":"2024-04-26T22:04:09.776805+0000","last_became_active":"2024-04-26T21:37:21.498054+0000","last_became_peered":"2024-04-26T21:37:21.498054+0000","last_unstale":"2024-04-26T22:04:09.776805+0000","last_undegraded":"2024-04-26T22:04:09.776805+0000","last_fullsized":"2024-04-26T22:04:09.776805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2202","last_scrub_stamp":"2024-04-26T22:04:09.776621+0000","last_deep_scrub":"26'2202","last_deep_scrub_stamp":"2024-04-26T22:04:09.776621+0000","last_clean_scrub_stamp":"2024-04-26T22:04:09.776621+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:28.733988+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":59602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'492","reported_seq":537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.721962+0000","last_change":"2024-04-26T22:04:07.722020+0000","last_active":"2024-04-26T22:04:07.721962+0000","last_peered":"2024-04-26T22:04:07.721962+0000","last_clean":"2024-04-26T22:04:07.721962+0000","last_became_active":"2024-04-26T21:37:17.451883+0000","last_became_peered":"2024-04-26T21:37:17.451883+0000","last_unstale":"2024-04-26T22:04:07.721962+0000","last_undegraded":"2024-04-26T22:04:07.721962+0000","last_fullsized":"2024-04-26T22:04:07.721962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'492","last_scrub_stamp":"2024-04-26T22:04:07.721798+0000","last_deep_scrub":"26'492","last_deep_scrub_stamp":"2024-04-26T22:04:07.721798+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.721798+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:55:03.061290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'938","reported_seq":985,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:57.952962+0000","last_change":"2024-04-26T22:03:57.953081+0000","last_active":"2024-04-26T22:03:57.952962+0000","last_peered":"2024-04-26T22:03:57.952962+0000","last_clean":"2024-04-26T22:03:57.952962+0000","last_became_active":"2024-04-26T21:37:16.424590+0000","last_became_peered":"2024-04-26T21:37:16.424590+0000","last_unstale":"2024-04-26T22:03:57.952962+0000","last_undegraded":"2024-04-26T22:03:57.952962+0000","last_fullsized":"2024-04-26T22:03:57.952962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'938","last_scrub_stamp":"2024-04-26T22:03:57.952688+0000","last_deep_scrub":"26'938","last_deep_scrub_stamp":"2024-04-26T22:03:57.952688+0000","last_clean_scrub_stamp":"2024-04-26T22:03:57.952688+0000","objects_scrubbed":1,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:21.570582+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":8651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":206,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.444221+0000","last_change":"2024-04-26T22:03:59.444357+0000","last_active":"2024-04-26T22:03:59.444221+0000","last_peered":"2024-04-26T22:03:59.444221+0000","last_clean":"2024-04-26T22:03:59.444221+0000","last_became_active":"2024-04-26T21:37:06.854472+0000","last_became_peered":"2024-04-26T21:37:06.854472+0000","last_unstale":"2024-04-26T22:03:59.444221+0000","last_undegraded":"2024-04-26T22:03:59.444221+0000","last_fullsized":"2024-04-26T22:03:59.444221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-26T22:03:59.444006+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-26T22:03:59.444006+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.444006+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:23.061900+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2218","reported_seq":2257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:12.372696+0000","last_change":"2024-04-26T22:04:12.372760+0000","last_active":"2024-04-26T22:04:12.372696+0000","last_peered":"2024-04-26T22:04:12.372696+0000","last_clean":"2024-04-26T22:04:12.372696+0000","last_became_active":"2024-04-26T21:37:21.507125+0000","last_became_peered":"2024-04-26T21:37:21.507125+0000","last_unstale":"2024-04-26T22:04:12.372696+0000","last_undegraded":"2024-04-26T22:04:12.372696+0000","last_fullsized":"2024-04-26T22:04:12.372696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2218","last_scrub_stamp":"2024-04-26T22:04:12.372496+0000","last_deep_scrub":"26'2218","last_deep_scrub_stamp":"2024-04-26T22:04:12.372496+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.372496+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:47.777871+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1718,"num_write_kb":49388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'483","reported_seq":527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:12.396374+0000","last_change":"2024-04-26T22:04:12.396434+0000","last_active":"2024-04-26T22:04:12.396374+0000","last_peered":"2024-04-26T22:04:12.396374+0000","last_clean":"2024-04-26T22:04:12.396374+0000","last_became_active":"2024-04-26T21:37:17.454879+0000","last_became_peered":"2024-04-26T21:37:17.454879+0000","last_unstale":"2024-04-26T22:04:12.396374+0000","last_undegraded":"2024-04-26T22:04:12.396374+0000","last_fullsized":"2024-04-26T22:04:12.396374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'483","last_scrub_stamp":"2024-04-26T22:04:12.396202+0000","last_deep_scrub":"26'483","last_deep_scrub_stamp":"2024-04-26T22:04:12.396202+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.396202+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:31.353569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'1339","reported_seq":1385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:57.677617+0000","last_change":"2024-04-26T22:03:57.677694+0000","last_active":"2024-04-26T22:03:57.677617+0000","last_peered":"2024-04-26T22:03:57.677617+0000","last_clean":"2024-04-26T22:03:57.677617+0000","last_became_active":"2024-04-26T21:37:16.435458+0000","last_became_peered":"2024-04-26T21:37:16.435458+0000","last_unstale":"2024-04-26T22:03:57.677617+0000","last_undegraded":"2024-04-26T22:03:57.677617+0000","last_fullsized":"2024-04-26T22:03:57.677617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1339","last_scrub_stamp":"2024-04-26T22:03:57.677405+0000","last_deep_scrub":"26'1339","last_deep_scrub_stamp":"2024-04-26T22:03:57.677405+0000","last_clean_scrub_stamp":"2024-04-26T22:03:57.677405+0000","objects_scrubbed":2,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.259022+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":12939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'2226","reported_seq":2265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:10.341561+0000","last_change":"2024-04-26T22:04:10.341682+0000","last_active":"2024-04-26T22:04:10.341561+0000","last_peered":"2024-04-26T22:04:10.341561+0000","last_clean":"2024-04-26T22:04:10.341561+0000","last_became_active":"2024-04-26T21:37:21.502583+0000","last_became_peered":"2024-04-26T21:37:21.502583+0000","last_unstale":"2024-04-26T22:04:10.341561+0000","last_undegraded":"2024-04-26T22:04:10.341561+0000","last_fullsized":"2024-04-26T22:04:10.341561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2226","last_scrub_stamp":"2024-04-26T22:04:10.341341+0000","last_deep_scrub":"26'2226","last_deep_scrub_stamp":"2024-04-26T22:04:10.341341+0000","last_clean_scrub_stamp":"2024-04-26T22:04:10.341341+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:47.491794+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":82996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'526","reported_seq":570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.982967+0000","last_change":"2024-04-26T22:04:03.983031+0000","last_active":"2024-04-26T22:04:03.982967+0000","last_peered":"2024-04-26T22:04:03.982967+0000","last_clean":"2024-04-26T22:04:03.982967+0000","last_became_active":"2024-04-26T21:37:17.443527+0000","last_became_peered":"2024-04-26T21:37:17.443527+0000","last_unstale":"2024-04-26T22:04:03.982967+0000","last_undegraded":"2024-04-26T22:04:03.982967+0000","last_fullsized":"2024-04-26T22:04:03.982967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'526","last_scrub_stamp":"2024-04-26T22:04:03.982668+0000","last_deep_scrub":"26'526","last_deep_scrub_stamp":"2024-04-26T22:04:03.982668+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.982668+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:23.518770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2777","reported_seq":2823,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.109015+0000","last_change":"2024-04-26T22:03:58.109094+0000","last_active":"2024-04-26T22:03:58.109015+0000","last_peered":"2024-04-26T22:03:58.109015+0000","last_clean":"2024-04-26T22:03:58.109015+0000","last_became_active":"2024-04-26T21:37:16.436086+0000","last_became_peered":"2024-04-26T21:37:16.436086+0000","last_unstale":"2024-04-26T22:03:58.109015+0000","last_undegraded":"2024-04-26T22:03:58.109015+0000","last_fullsized":"2024-04-26T22:03:58.109015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2777","last_scrub_stamp":"2024-04-26T22:03:58.108841+0000","last_deep_scrub":"26'2777","last_deep_scrub_stamp":"2024-04-26T22:03:58.108841+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.108841+0000","objects_scrubbed":6,"log_size":2777,"log_dups_size":0,"ondisk_log_size":2777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:25.821868+0000","scrub_duration":120,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971590,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2774,"num_write_kb":25944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1964","reported_seq":2002,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.734783+0000","last_change":"2024-04-26T22:04:05.734847+0000","last_active":"2024-04-26T22:04:05.734783+0000","last_peered":"2024-04-26T22:04:05.734783+0000","last_clean":"2024-04-26T22:04:05.734783+0000","last_became_active":"2024-04-26T21:37:21.494537+0000","last_became_peered":"2024-04-26T21:37:21.494537+0000","last_unstale":"2024-04-26T22:04:05.734783+0000","last_undegraded":"2024-04-26T22:04:05.734783+0000","last_fullsized":"2024-04-26T22:04:05.734783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1964","last_scrub_stamp":"2024-04-26T22:04:05.734589+0000","last_deep_scrub":"26'1964","last_deep_scrub_stamp":"2024-04-26T22:04:05.734589+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.734589+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:40.616829+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'495","reported_seq":539,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:10.433787+0000","last_change":"2024-04-26T22:04:10.433934+0000","last_active":"2024-04-26T22:04:10.433787+0000","last_peered":"2024-04-26T22:04:10.433787+0000","last_clean":"2024-04-26T22:04:10.433787+0000","last_became_active":"2024-04-26T21:37:17.455829+0000","last_became_peered":"2024-04-26T21:37:17.455829+0000","last_unstale":"2024-04-26T22:04:10.433787+0000","last_undegraded":"2024-04-26T22:04:10.433787+0000","last_fullsized":"2024-04-26T22:04:10.433787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'495","last_scrub_stamp":"2024-04-26T22:04:10.433584+0000","last_deep_scrub":"26'495","last_deep_scrub_stamp":"2024-04-26T22:04:10.433584+0000","last_clean_scrub_stamp":"2024-04-26T22:04:10.433584+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:52:08.093828+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'1462","reported_seq":1508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:54.629595+0000","last_change":"2024-04-26T22:03:54.629633+0000","last_active":"2024-04-26T22:03:54.629595+0000","last_peered":"2024-04-26T22:03:54.629595+0000","last_clean":"2024-04-26T22:03:54.629595+0000","last_became_active":"2024-04-26T21:37:16.418144+0000","last_became_peered":"2024-04-26T21:37:16.418144+0000","last_unstale":"2024-04-26T22:03:54.629595+0000","last_undegraded":"2024-04-26T22:03:54.629595+0000","last_fullsized":"2024-04-26T22:03:54.629595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1462","last_scrub_stamp":"2024-04-26T22:03:54.629504+0000","last_deep_scrub":"26'1462","last_deep_scrub_stamp":"2024-04-26T22:03:54.629504+0000","last_clean_scrub_stamp":"2024-04-26T22:03:54.629504+0000","objects_scrubbed":3,"log_size":1462,"log_dups_size":0,"ondisk_log_size":1462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:34.436575+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1458,"num_write_kb":12981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'2194","reported_seq":2233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:13.016456+0000","last_change":"2024-04-26T22:04:13.016521+0000","last_active":"2024-04-26T22:04:13.016456+0000","last_peered":"2024-04-26T22:04:13.016456+0000","last_clean":"2024-04-26T22:04:13.016456+0000","last_became_active":"2024-04-26T21:37:21.497644+0000","last_became_peered":"2024-04-26T21:37:21.497644+0000","last_unstale":"2024-04-26T22:04:13.016456+0000","last_undegraded":"2024-04-26T22:04:13.016456+0000","last_fullsized":"2024-04-26T22:04:13.016456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2194","last_scrub_stamp":"2024-04-26T22:04:13.016263+0000","last_deep_scrub":"26'2194","last_deep_scrub_stamp":"2024-04-26T22:04:13.016263+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.016263+0000","objects_scrubbed":0,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:55:39.628985+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":50061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'500","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:11.405516+0000","last_change":"2024-04-26T22:04:11.405574+0000","last_active":"2024-04-26T22:04:11.405516+0000","last_peered":"2024-04-26T22:04:11.405516+0000","last_clean":"2024-04-26T22:04:11.405516+0000","last_became_active":"2024-04-26T21:37:17.456150+0000","last_became_peered":"2024-04-26T21:37:17.456150+0000","last_unstale":"2024-04-26T22:04:11.405516+0000","last_undegraded":"2024-04-26T22:04:11.405516+0000","last_fullsized":"2024-04-26T22:04:11.405516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'500","last_scrub_stamp":"2024-04-26T22:04:11.405338+0000","last_deep_scrub":"26'500","last_deep_scrub_stamp":"2024-04-26T22:04:11.405338+0000","last_clean_scrub_stamp":"2024-04-26T22:04:11.405338+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:26.463494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1058","reported_seq":1104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:56.497047+0000","last_change":"2024-04-26T22:03:56.497129+0000","last_active":"2024-04-26T22:03:56.497047+0000","last_peered":"2024-04-26T22:03:56.497047+0000","last_clean":"2024-04-26T22:03:56.497047+0000","last_became_active":"2024-04-26T21:37:16.425551+0000","last_became_peered":"2024-04-26T21:37:16.425551+0000","last_unstale":"2024-04-26T22:03:56.497047+0000","last_undegraded":"2024-04-26T22:03:56.497047+0000","last_fullsized":"2024-04-26T22:03:56.497047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1058","last_scrub_stamp":"2024-04-26T22:03:56.496856+0000","last_deep_scrub":"26'1058","last_deep_scrub_stamp":"2024-04-26T22:03:56.496856+0000","last_clean_scrub_stamp":"2024-04-26T22:03:56.496856+0000","objects_scrubbed":2,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:57.019991+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1059,"num_write_kb":8718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2324","reported_seq":2370,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:09.509568+0000","last_change":"2024-04-26T22:04:09.509634+0000","last_active":"2024-04-26T22:04:09.509568+0000","last_peered":"2024-04-26T22:04:09.509568+0000","last_clean":"2024-04-26T22:04:09.509568+0000","last_became_active":"2024-04-26T21:37:58.754532+0000","last_became_peered":"2024-04-26T21:37:58.754532+0000","last_unstale":"2024-04-26T22:04:09.509568+0000","last_undegraded":"2024-04-26T22:04:09.509568+0000","last_fullsized":"2024-04-26T22:04:09.509568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2324","last_scrub_stamp":"2024-04-26T22:04:09.509397+0000","last_deep_scrub":"26'2324","last_deep_scrub_stamp":"2024-04-26T22:04:09.509397+0000","last_clean_scrub_stamp":"2024-04-26T22:04:09.509397+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:44.914772+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":34587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'539","reported_seq":583,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.443488+0000","last_change":"2024-04-26T22:03:58.443545+0000","last_active":"2024-04-26T22:03:58.443488+0000","last_peered":"2024-04-26T22:03:58.443488+0000","last_clean":"2024-04-26T22:03:58.443488+0000","last_became_active":"2024-04-26T21:37:17.435356+0000","last_became_peered":"2024-04-26T21:37:17.435356+0000","last_unstale":"2024-04-26T22:03:58.443488+0000","last_undegraded":"2024-04-26T22:03:58.443488+0000","last_fullsized":"2024-04-26T22:03:58.443488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'539","last_scrub_stamp":"2024-04-26T22:03:58.443323+0000","last_deep_scrub":"26'539","last_deep_scrub_stamp":"2024-04-26T22:03:58.443323+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.443323+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:18.377460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'945","reported_seq":991,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:56.652469+0000","last_change":"2024-04-26T22:03:56.652586+0000","last_active":"2024-04-26T22:03:56.652469+0000","last_peered":"2024-04-26T22:03:56.652469+0000","last_clean":"2024-04-26T22:03:56.652469+0000","last_became_active":"2024-04-26T21:37:16.427920+0000","last_became_peered":"2024-04-26T21:37:16.427920+0000","last_unstale":"2024-04-26T22:03:56.652469+0000","last_undegraded":"2024-04-26T22:03:56.652469+0000","last_fullsized":"2024-04-26T22:03:56.652469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'945","last_scrub_stamp":"2024-04-26T22:03:56.652222+0000","last_deep_scrub":"26'945","last_deep_scrub_stamp":"2024-04-26T22:03:56.652222+0000","last_clean_scrub_stamp":"2024-04-26T22:03:56.652222+0000","objects_scrubbed":4,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:48.794684+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":8676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'1956","reported_seq":1994,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.738385+0000","last_change":"2024-04-26T22:04:07.738449+0000","last_active":"2024-04-26T22:04:07.738385+0000","last_peered":"2024-04-26T22:04:07.738385+0000","last_clean":"2024-04-26T22:04:07.738385+0000","last_became_active":"2024-04-26T21:37:21.497348+0000","last_became_peered":"2024-04-26T21:37:21.497348+0000","last_unstale":"2024-04-26T22:04:07.738385+0000","last_undegraded":"2024-04-26T22:04:07.738385+0000","last_fullsized":"2024-04-26T22:04:07.738385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1956","last_scrub_stamp":"2024-04-26T22:04:07.738210+0000","last_deep_scrub":"26'1956","last_deep_scrub_stamp":"2024-04-26T22:04:07.738210+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.738210+0000","objects_scrubbed":0,"log_size":1956,"log_dups_size":0,"ondisk_log_size":1956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:52:05.398455+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1477,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'502","reported_seq":546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:06.274827+0000","last_change":"2024-04-26T22:04:06.274997+0000","last_active":"2024-04-26T22:04:06.274827+0000","last_peered":"2024-04-26T22:04:06.274827+0000","last_clean":"2024-04-26T22:04:06.274827+0000","last_became_active":"2024-04-26T21:37:17.452545+0000","last_became_peered":"2024-04-26T21:37:17.452545+0000","last_unstale":"2024-04-26T22:04:06.274827+0000","last_undegraded":"2024-04-26T22:04:06.274827+0000","last_fullsized":"2024-04-26T22:04:06.274827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'502","last_scrub_stamp":"2024-04-26T22:04:06.274630+0000","last_deep_scrub":"26'502","last_deep_scrub_stamp":"2024-04-26T22:04:06.274630+0000","last_clean_scrub_stamp":"2024-04-26T22:04:06.274630+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:41.897304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'16","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.306966+0000","last_change":"2024-04-26T22:03:59.307076+0000","last_active":"2024-04-26T22:03:59.306966+0000","last_peered":"2024-04-26T22:03:59.306966+0000","last_clean":"2024-04-26T22:03:59.306966+0000","last_became_active":"2024-04-26T21:37:16.440290+0000","last_became_peered":"2024-04-26T21:37:16.440290+0000","last_unstale":"2024-04-26T22:03:59.306966+0000","last_undegraded":"2024-04-26T22:03:59.306966+0000","last_fullsized":"2024-04-26T22:03:59.306966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-04-26T22:03:59.306647+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-04-26T22:03:59.306647+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.306647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:12.079790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2142","reported_seq":2180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:12.757889+0000","last_change":"2024-04-26T22:04:12.757953+0000","last_active":"2024-04-26T22:04:12.757889+0000","last_peered":"2024-04-26T22:04:12.757889+0000","last_clean":"2024-04-26T22:04:12.757889+0000","last_became_active":"2024-04-26T21:37:21.494588+0000","last_became_peered":"2024-04-26T21:37:21.494588+0000","last_unstale":"2024-04-26T22:04:12.757889+0000","last_undegraded":"2024-04-26T22:04:12.757889+0000","last_fullsized":"2024-04-26T22:04:12.757889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2142","last_scrub_stamp":"2024-04-26T22:04:12.757689+0000","last_deep_scrub":"26'2142","last_deep_scrub_stamp":"2024-04-26T22:04:12.757689+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.757689+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:14.603496+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1648,"num_write_kb":35594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'514","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.581228+0000","last_change":"2024-04-26T22:04:00.581384+0000","last_active":"2024-04-26T22:04:00.581228+0000","last_peered":"2024-04-26T22:04:00.581228+0000","last_clean":"2024-04-26T22:04:00.581228+0000","last_became_active":"2024-04-26T21:37:58.751458+0000","last_became_peered":"2024-04-26T21:37:58.751458+0000","last_unstale":"2024-04-26T22:04:00.581228+0000","last_undegraded":"2024-04-26T22:04:00.581228+0000","last_fullsized":"2024-04-26T22:04:00.581228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'514","last_scrub_stamp":"2024-04-26T22:04:00.581017+0000","last_deep_scrub":"26'514","last_deep_scrub_stamp":"2024-04-26T22:04:00.581017+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.581017+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:41.724383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"26'9","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.896167+0000","last_change":"2024-04-26T22:03:59.896280+0000","last_active":"2024-04-26T22:03:59.896167+0000","last_peered":"2024-04-26T22:03:59.896167+0000","last_clean":"2024-04-26T22:03:59.896167+0000","last_became_active":"2024-04-26T21:37:16.436910+0000","last_became_peered":"2024-04-26T21:37:16.436910+0000","last_unstale":"2024-04-26T22:03:59.896167+0000","last_undegraded":"2024-04-26T22:03:59.896167+0000","last_fullsized":"2024-04-26T22:03:59.896167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-26T22:03:59.895906+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-26T22:03:59.895906+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.895906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:17.383127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'2060","reported_seq":2098,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:08.714136+0000","last_change":"2024-04-26T22:04:08.714201+0000","last_active":"2024-04-26T22:04:08.714136+0000","last_peered":"2024-04-26T22:04:08.714136+0000","last_clean":"2024-04-26T22:04:08.714136+0000","last_became_active":"2024-04-26T21:37:21.479828+0000","last_became_peered":"2024-04-26T21:37:21.479828+0000","last_unstale":"2024-04-26T22:04:08.714136+0000","last_undegraded":"2024-04-26T22:04:08.714136+0000","last_fullsized":"2024-04-26T22:04:08.714136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2060","last_scrub_stamp":"2024-04-26T22:04:08.713942+0000","last_deep_scrub":"26'2060","last_deep_scrub_stamp":"2024-04-26T22:04:08.713942+0000","last_clean_scrub_stamp":"2024-04-26T22:04:08.713942+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:27.671308+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1564,"num_write_kb":74671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'496","reported_seq":540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:57.698346+0000","last_change":"2024-04-26T22:03:57.698403+0000","last_active":"2024-04-26T22:03:57.698346+0000","last_peered":"2024-04-26T22:03:57.698346+0000","last_clean":"2024-04-26T22:03:57.698346+0000","last_became_active":"2024-04-26T21:37:17.431044+0000","last_became_peered":"2024-04-26T21:37:17.431044+0000","last_unstale":"2024-04-26T22:03:57.698346+0000","last_undegraded":"2024-04-26T22:03:57.698346+0000","last_fullsized":"2024-04-26T22:03:57.698346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'496","last_scrub_stamp":"2024-04-26T22:03:57.698264+0000","last_deep_scrub":"26'496","last_deep_scrub_stamp":"2024-04-26T22:03:57.698264+0000","last_clean_scrub_stamp":"2024-04-26T22:03:57.698264+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:23:35.950577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'1739","reported_seq":1785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:54.666337+0000","last_change":"2024-04-26T22:03:54.666377+0000","last_active":"2024-04-26T22:03:54.666337+0000","last_peered":"2024-04-26T22:03:54.666337+0000","last_clean":"2024-04-26T22:03:54.666337+0000","last_became_active":"2024-04-26T21:37:16.434123+0000","last_became_peered":"2024-04-26T21:37:16.434123+0000","last_unstale":"2024-04-26T22:03:54.666337+0000","last_undegraded":"2024-04-26T22:03:54.666337+0000","last_fullsized":"2024-04-26T22:03:54.666337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1739","last_scrub_stamp":"2024-04-26T22:03:54.666244+0000","last_deep_scrub":"26'1739","last_deep_scrub_stamp":"2024-04-26T22:03:54.666244+0000","last_clean_scrub_stamp":"2024-04-26T22:03:54.666244+0000","objects_scrubbed":3,"log_size":1739,"log_dups_size":0,"ondisk_log_size":1739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:14.600381+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1738,"num_write_kb":13055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'1982","reported_seq":2020,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:11.996840+0000","last_change":"2024-04-26T22:04:11.996936+0000","last_active":"2024-04-26T22:04:11.996840+0000","last_peered":"2024-04-26T22:04:11.996840+0000","last_clean":"2024-04-26T22:04:11.996840+0000","last_became_active":"2024-04-26T21:37:21.485498+0000","last_became_peered":"2024-04-26T21:37:21.485498+0000","last_unstale":"2024-04-26T22:04:11.996840+0000","last_undegraded":"2024-04-26T22:04:11.996840+0000","last_fullsized":"2024-04-26T22:04:11.996840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1982","last_scrub_stamp":"2024-04-26T22:04:11.996654+0000","last_deep_scrub":"26'1982","last_deep_scrub_stamp":"2024-04-26T22:04:11.996654+0000","last_clean_scrub_stamp":"2024-04-26T22:04:11.996654+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:30.954021+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1494,"num_write_kb":56826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'493","reported_seq":537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:06.421551+0000","last_change":"2024-04-26T22:04:06.421614+0000","last_active":"2024-04-26T22:04:06.421551+0000","last_peered":"2024-04-26T22:04:06.421551+0000","last_clean":"2024-04-26T22:04:06.421551+0000","last_became_active":"2024-04-26T21:37:17.435108+0000","last_became_peered":"2024-04-26T21:37:17.435108+0000","last_unstale":"2024-04-26T22:04:06.421551+0000","last_undegraded":"2024-04-26T22:04:06.421551+0000","last_fullsized":"2024-04-26T22:04:06.421551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'493","last_scrub_stamp":"2024-04-26T22:04:06.421372+0000","last_deep_scrub":"26'493","last_deep_scrub_stamp":"2024-04-26T22:04:06.421372+0000","last_clean_scrub_stamp":"2024-04-26T22:04:06.421372+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:55.200688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'2897","reported_seq":2943,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.390571+0000","last_change":"2024-04-26T22:04:00.390649+0000","last_active":"2024-04-26T22:04:00.390571+0000","last_peered":"2024-04-26T22:04:00.390571+0000","last_clean":"2024-04-26T22:04:00.390571+0000","last_became_active":"2024-04-26T21:37:16.440898+0000","last_became_peered":"2024-04-26T21:37:16.440898+0000","last_unstale":"2024-04-26T22:04:00.390571+0000","last_undegraded":"2024-04-26T22:04:00.390571+0000","last_fullsized":"2024-04-26T22:04:00.390571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2897","last_scrub_stamp":"2024-04-26T22:04:00.390402+0000","last_deep_scrub":"26'2897","last_deep_scrub_stamp":"2024-04-26T22:04:00.390402+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.390402+0000","objects_scrubbed":5,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:17.788334+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2889,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'2295","reported_seq":2333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:10.197753+0000","last_change":"2024-04-26T22:04:10.197789+0000","last_active":"2024-04-26T22:04:10.197753+0000","last_peered":"2024-04-26T22:04:10.197753+0000","last_clean":"2024-04-26T22:04:10.197753+0000","last_became_active":"2024-04-26T21:37:21.501616+0000","last_became_peered":"2024-04-26T21:37:21.501616+0000","last_unstale":"2024-04-26T22:04:10.197753+0000","last_undegraded":"2024-04-26T22:04:10.197753+0000","last_fullsized":"2024-04-26T22:04:10.197753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2295","last_scrub_stamp":"2024-04-26T22:04:10.197631+0000","last_deep_scrub":"26'2295","last_deep_scrub_stamp":"2024-04-26T22:04:10.197631+0000","last_clean_scrub_stamp":"2024-04-26T22:04:10.197631+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:07.407311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":114189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'491","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:57.471596+0000","last_change":"2024-04-26T22:03:57.471655+0000","last_active":"2024-04-26T22:03:57.471596+0000","last_peered":"2024-04-26T22:03:57.471596+0000","last_clean":"2024-04-26T22:03:57.471596+0000","last_became_active":"2024-04-26T21:37:17.421907+0000","last_became_peered":"2024-04-26T21:37:17.421907+0000","last_unstale":"2024-04-26T22:03:57.471596+0000","last_undegraded":"2024-04-26T22:03:57.471596+0000","last_fullsized":"2024-04-26T22:03:57.471596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'491","last_scrub_stamp":"2024-04-26T22:03:57.471414+0000","last_deep_scrub":"26'491","last_deep_scrub_stamp":"2024-04-26T22:03:57.471414+0000","last_clean_scrub_stamp":"2024-04-26T22:03:57.471414+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:10.244556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3659","reported_seq":3705,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.155003+0000","last_change":"2024-04-26T22:04:00.155145+0000","last_active":"2024-04-26T22:04:00.155003+0000","last_peered":"2024-04-26T22:04:00.155003+0000","last_clean":"2024-04-26T22:04:00.155003+0000","last_became_active":"2024-04-26T21:37:16.437076+0000","last_became_peered":"2024-04-26T21:37:16.437076+0000","last_unstale":"2024-04-26T22:04:00.155003+0000","last_undegraded":"2024-04-26T22:04:00.155003+0000","last_fullsized":"2024-04-26T22:04:00.155003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3659","last_scrub_stamp":"2024-04-26T22:04:00.154785+0000","last_deep_scrub":"26'3659","last_deep_scrub_stamp":"2024-04-26T22:04:00.154785+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.154785+0000","objects_scrubbed":6,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:56.756935+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3659,"num_write_kb":22929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'2192","reported_seq":2230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.462774+0000","last_change":"2024-04-26T22:04:05.462841+0000","last_active":"2024-04-26T22:04:05.462774+0000","last_peered":"2024-04-26T22:04:05.462774+0000","last_clean":"2024-04-26T22:04:05.462774+0000","last_became_active":"2024-04-26T21:37:21.496820+0000","last_became_peered":"2024-04-26T21:37:21.496820+0000","last_unstale":"2024-04-26T22:04:05.462774+0000","last_undegraded":"2024-04-26T22:04:05.462774+0000","last_fullsized":"2024-04-26T22:04:05.462774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2192","last_scrub_stamp":"2024-04-26T22:04:05.462585+0000","last_deep_scrub":"26'2192","last_deep_scrub_stamp":"2024-04-26T22:04:05.462585+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.462585+0000","objects_scrubbed":0,"log_size":2192,"log_dups_size":0,"ondisk_log_size":2192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:38.211303+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1701,"num_write_kb":143042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'491","reported_seq":535,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.721275+0000","last_change":"2024-04-26T22:04:03.721334+0000","last_active":"2024-04-26T22:04:03.721275+0000","last_peered":"2024-04-26T22:04:03.721275+0000","last_clean":"2024-04-26T22:04:03.721275+0000","last_became_active":"2024-04-26T21:37:17.451272+0000","last_became_peered":"2024-04-26T21:37:17.451272+0000","last_unstale":"2024-04-26T22:04:03.721275+0000","last_undegraded":"2024-04-26T22:04:03.721275+0000","last_fullsized":"2024-04-26T22:04:03.721275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'491","last_scrub_stamp":"2024-04-26T22:04:03.721107+0000","last_deep_scrub":"26'491","last_deep_scrub_stamp":"2024-04-26T22:04:03.721107+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.721107+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:20.599246+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2010","reported_seq":2056,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.987647+0000","last_change":"2024-04-26T22:04:01.987727+0000","last_active":"2024-04-26T22:04:01.987647+0000","last_peered":"2024-04-26T22:04:01.987647+0000","last_clean":"2024-04-26T22:04:01.987647+0000","last_became_active":"2024-04-26T21:37:16.443443+0000","last_became_peered":"2024-04-26T21:37:16.443443+0000","last_unstale":"2024-04-26T22:04:01.987647+0000","last_undegraded":"2024-04-26T22:04:01.987647+0000","last_fullsized":"2024-04-26T22:04:01.987647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2010","last_scrub_stamp":"2024-04-26T22:04:01.987465+0000","last_deep_scrub":"26'2010","last_deep_scrub_stamp":"2024-04-26T22:04:01.987465+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.987465+0000","objects_scrubbed":4,"log_size":2010,"log_dups_size":0,"ondisk_log_size":2010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:09.507544+0000","scrub_duration":106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":21501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'2154","reported_seq":2192,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:14.753872+0000","last_change":"2024-04-26T22:04:14.753937+0000","last_active":"2024-04-26T22:04:14.753872+0000","last_peered":"2024-04-26T22:04:14.753872+0000","last_clean":"2024-04-26T22:04:14.753872+0000","last_became_active":"2024-04-26T21:37:21.496449+0000","last_became_peered":"2024-04-26T21:37:21.496449+0000","last_unstale":"2024-04-26T22:04:14.753872+0000","last_undegraded":"2024-04-26T22:04:14.753872+0000","last_fullsized":"2024-04-26T22:04:14.753872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2154","last_scrub_stamp":"2024-04-26T22:04:14.753680+0000","last_deep_scrub":"26'2154","last_deep_scrub_stamp":"2024-04-26T22:04:14.753680+0000","last_clean_scrub_stamp":"2024-04-26T22:04:14.753680+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:16.426430+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1666,"num_write_kb":39964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'495","reported_seq":524,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.552436+0000","last_change":"2024-04-26T22:04:01.552498+0000","last_active":"2024-04-26T22:04:01.552436+0000","last_peered":"2024-04-26T22:04:01.552436+0000","last_clean":"2024-04-26T22:04:01.552436+0000","last_became_active":"2024-04-26T21:37:58.752756+0000","last_became_peered":"2024-04-26T21:37:58.752756+0000","last_unstale":"2024-04-26T22:04:01.552436+0000","last_undegraded":"2024-04-26T22:04:01.552436+0000","last_fullsized":"2024-04-26T22:04:01.552436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'495","last_scrub_stamp":"2024-04-26T22:04:01.552259+0000","last_deep_scrub":"26'495","last_deep_scrub_stamp":"2024-04-26T22:04:01.552259+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.552259+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.374091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'567","reported_seq":613,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.314385+0000","last_change":"2024-04-26T22:04:01.314454+0000","last_active":"2024-04-26T22:04:01.314385+0000","last_peered":"2024-04-26T22:04:01.314385+0000","last_clean":"2024-04-26T22:04:01.314385+0000","last_became_active":"2024-04-26T21:37:16.444135+0000","last_became_peered":"2024-04-26T21:37:16.444135+0000","last_unstale":"2024-04-26T22:04:01.314385+0000","last_undegraded":"2024-04-26T22:04:01.314385+0000","last_fullsized":"2024-04-26T22:04:01.314385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'567","last_scrub_stamp":"2024-04-26T22:04:01.314182+0000","last_deep_scrub":"26'567","last_deep_scrub_stamp":"2024-04-26T22:04:01.314182+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.314182+0000","objects_scrubbed":1,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:24.932075+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'2246","reported_seq":2284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:11.776423+0000","last_change":"2024-04-26T22:04:11.776486+0000","last_active":"2024-04-26T22:04:11.776423+0000","last_peered":"2024-04-26T22:04:11.776423+0000","last_clean":"2024-04-26T22:04:11.776423+0000","last_became_active":"2024-04-26T21:37:21.491849+0000","last_became_peered":"2024-04-26T21:37:21.491849+0000","last_unstale":"2024-04-26T22:04:11.776423+0000","last_undegraded":"2024-04-26T22:04:11.776423+0000","last_fullsized":"2024-04-26T22:04:11.776423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2246","last_scrub_stamp":"2024-04-26T22:04:11.776237+0000","last_deep_scrub":"26'2246","last_deep_scrub_stamp":"2024-04-26T22:04:11.776237+0000","last_clean_scrub_stamp":"2024-04-26T22:04:11.776237+0000","objects_scrubbed":0,"log_size":2246,"log_dups_size":0,"ondisk_log_size":2246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:14.493790+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1740,"num_write_kb":51745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'2287","reported_seq":2327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:08.745929+0000","last_change":"2024-04-26T22:04:08.746084+0000","last_active":"2024-04-26T22:04:08.745929+0000","last_peered":"2024-04-26T22:04:08.745929+0000","last_clean":"2024-04-26T22:04:08.745929+0000","last_became_active":"2024-04-26T21:37:21.501698+0000","last_became_peered":"2024-04-26T21:37:21.501698+0000","last_unstale":"2024-04-26T22:04:08.745929+0000","last_undegraded":"2024-04-26T22:04:08.745929+0000","last_fullsized":"2024-04-26T22:04:08.745929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2287","last_scrub_stamp":"2024-04-26T22:04:08.745710+0000","last_deep_scrub":"26'2287","last_deep_scrub_stamp":"2024-04-26T22:04:08.745710+0000","last_clean_scrub_stamp":"2024-04-26T22:04:08.745710+0000","objects_scrubbed":0,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:55:04.085203+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1846,"num_write_kb":61262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'494","reported_seq":538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:53.993596+0000","last_change":"2024-04-26T22:03:53.993596+0000","last_active":"2024-04-26T22:03:53.993596+0000","last_peered":"2024-04-26T22:03:53.993596+0000","last_clean":"2024-04-26T22:03:53.993596+0000","last_became_active":"2024-04-26T21:37:17.433611+0000","last_became_peered":"2024-04-26T21:37:17.433611+0000","last_unstale":"2024-04-26T22:03:53.993596+0000","last_undegraded":"2024-04-26T22:03:53.993596+0000","last_fullsized":"2024-04-26T22:03:53.993596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'494","last_scrub_stamp":"2024-04-26T22:03:53.993304+0000","last_deep_scrub":"26'494","last_deep_scrub_stamp":"2024-04-26T22:03:53.993304+0000","last_clean_scrub_stamp":"2024-04-26T22:03:53.993304+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:06.766446+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2603","reported_seq":2649,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.971002+0000","last_change":"2024-04-26T22:03:58.971082+0000","last_active":"2024-04-26T22:03:58.971002+0000","last_peered":"2024-04-26T22:03:58.971002+0000","last_clean":"2024-04-26T22:03:58.971002+0000","last_became_active":"2024-04-26T21:37:16.434529+0000","last_became_peered":"2024-04-26T21:37:16.434529+0000","last_unstale":"2024-04-26T22:03:58.971002+0000","last_undegraded":"2024-04-26T22:03:58.971002+0000","last_fullsized":"2024-04-26T22:03:58.971002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2603","last_scrub_stamp":"2024-04-26T22:03:58.970800+0000","last_deep_scrub":"26'2603","last_deep_scrub_stamp":"2024-04-26T22:03:58.970800+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.970800+0000","objects_scrubbed":2,"log_size":2603,"log_dups_size":0,"ondisk_log_size":2603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:31.295225+0000","scrub_duration":61,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2601,"num_write_kb":21771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'2012","reported_seq":2051,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:11.379393+0000","last_change":"2024-04-26T22:04:11.379463+0000","last_active":"2024-04-26T22:04:11.379393+0000","last_peered":"2024-04-26T22:04:11.379393+0000","last_clean":"2024-04-26T22:04:11.379393+0000","last_became_active":"2024-04-26T21:37:21.505318+0000","last_became_peered":"2024-04-26T21:37:21.505318+0000","last_unstale":"2024-04-26T22:04:11.379393+0000","last_undegraded":"2024-04-26T22:04:11.379393+0000","last_fullsized":"2024-04-26T22:04:11.379393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2012","last_scrub_stamp":"2024-04-26T22:04:11.379206+0000","last_deep_scrub":"26'2012","last_deep_scrub_stamp":"2024-04-26T22:04:11.379206+0000","last_clean_scrub_stamp":"2024-04-26T22:04:11.379206+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.261446+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1553,"num_write_kb":109022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'573","reported_seq":617,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:57.720324+0000","last_change":"2024-04-26T22:03:57.720365+0000","last_active":"2024-04-26T22:03:57.720324+0000","last_peered":"2024-04-26T22:03:57.720324+0000","last_clean":"2024-04-26T22:03:57.720324+0000","last_became_active":"2024-04-26T21:37:17.451381+0000","last_became_peered":"2024-04-26T21:37:17.451381+0000","last_unstale":"2024-04-26T22:03:57.720324+0000","last_undegraded":"2024-04-26T22:03:57.720324+0000","last_fullsized":"2024-04-26T22:03:57.720324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'573","last_scrub_stamp":"2024-04-26T22:03:57.720205+0000","last_deep_scrub":"26'573","last_deep_scrub_stamp":"2024-04-26T22:03:57.720205+0000","last_clean_scrub_stamp":"2024-04-26T22:03:57.720205+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:03.228077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'453","reported_seq":499,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.647229+0000","last_change":"2024-04-26T22:04:01.647295+0000","last_active":"2024-04-26T22:04:01.647229+0000","last_peered":"2024-04-26T22:04:01.647229+0000","last_clean":"2024-04-26T22:04:01.647229+0000","last_became_active":"2024-04-26T21:37:16.432267+0000","last_became_peered":"2024-04-26T21:37:16.432267+0000","last_unstale":"2024-04-26T22:04:01.647229+0000","last_undegraded":"2024-04-26T22:04:01.647229+0000","last_fullsized":"2024-04-26T22:04:01.647229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'453","last_scrub_stamp":"2024-04-26T22:04:01.647041+0000","last_deep_scrub":"26'453","last_deep_scrub_stamp":"2024-04-26T22:04:01.647041+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.647041+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:34.395758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":4315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3508","reported_seq":3553,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.404155+0000","last_change":"2024-04-26T22:03:58.404226+0000","last_active":"2024-04-26T22:03:58.404155+0000","last_peered":"2024-04-26T22:03:58.404155+0000","last_clean":"2024-04-26T22:03:58.404155+0000","last_became_active":"2024-04-26T21:37:16.439010+0000","last_became_peered":"2024-04-26T21:37:16.439010+0000","last_unstale":"2024-04-26T22:03:58.404155+0000","last_undegraded":"2024-04-26T22:03:58.404155+0000","last_fullsized":"2024-04-26T22:03:58.404155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3508","last_scrub_stamp":"2024-04-26T22:03:58.404030+0000","last_deep_scrub":"26'3508","last_deep_scrub_stamp":"2024-04-26T22:03:58.404030+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.404030+0000","objects_scrubbed":4,"log_size":3508,"log_dups_size":0,"ondisk_log_size":3508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:19.342562+0000","scrub_duration":102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3514,"num_write_kb":30405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'488","reported_seq":531,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.684363+0000","last_change":"2024-04-26T22:03:58.684425+0000","last_active":"2024-04-26T22:03:58.684363+0000","last_peered":"2024-04-26T22:03:58.684363+0000","last_clean":"2024-04-26T22:03:58.684363+0000","last_became_active":"2024-04-26T21:37:17.436825+0000","last_became_peered":"2024-04-26T21:37:17.436825+0000","last_unstale":"2024-04-26T22:03:58.684363+0000","last_undegraded":"2024-04-26T22:03:58.684363+0000","last_fullsized":"2024-04-26T22:03:58.684363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'488","last_scrub_stamp":"2024-04-26T22:03:58.684190+0000","last_deep_scrub":"26'488","last_deep_scrub_stamp":"2024-04-26T22:03:58.684190+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.684190+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:04.192063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'2142","reported_seq":2186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.559280+0000","last_change":"2024-04-26T22:04:03.559350+0000","last_active":"2024-04-26T22:04:03.559280+0000","last_peered":"2024-04-26T22:04:03.559280+0000","last_clean":"2024-04-26T22:04:03.559280+0000","last_became_active":"2024-04-26T21:37:59.071221+0000","last_became_peered":"2024-04-26T21:37:59.071221+0000","last_unstale":"2024-04-26T22:04:03.559280+0000","last_undegraded":"2024-04-26T22:04:03.559280+0000","last_fullsized":"2024-04-26T22:04:03.559280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2142","last_scrub_stamp":"2024-04-26T22:04:03.559067+0000","last_deep_scrub":"26'2142","last_deep_scrub_stamp":"2024-04-26T22:04:03.559067+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.559067+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:20.956998+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":44570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1200","reported_seq":1245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:00.644730+0000","last_change":"2024-04-26T22:04:00.644797+0000","last_active":"2024-04-26T22:04:00.644730+0000","last_peered":"2024-04-26T22:04:00.644730+0000","last_clean":"2024-04-26T22:04:00.644730+0000","last_became_active":"2024-04-26T21:37:16.426090+0000","last_became_peered":"2024-04-26T21:37:16.426090+0000","last_unstale":"2024-04-26T22:04:00.644730+0000","last_undegraded":"2024-04-26T22:04:00.644730+0000","last_fullsized":"2024-04-26T22:04:00.644730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1200","last_scrub_stamp":"2024-04-26T22:04:00.644509+0000","last_deep_scrub":"26'1200","last_deep_scrub_stamp":"2024-04-26T22:04:00.644509+0000","last_clean_scrub_stamp":"2024-04-26T22:04:00.644509+0000","objects_scrubbed":1,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:20.180611+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'501","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.427954+0000","last_change":"2024-04-26T22:03:59.428024+0000","last_active":"2024-04-26T22:03:59.427954+0000","last_peered":"2024-04-26T22:03:59.427954+0000","last_clean":"2024-04-26T22:03:59.427954+0000","last_became_active":"2024-04-26T21:37:17.428155+0000","last_became_peered":"2024-04-26T21:37:17.428155+0000","last_unstale":"2024-04-26T22:03:59.427954+0000","last_undegraded":"2024-04-26T22:03:59.427954+0000","last_fullsized":"2024-04-26T22:03:59.427954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'501","last_scrub_stamp":"2024-04-26T22:03:59.427746+0000","last_deep_scrub":"26'501","last_deep_scrub_stamp":"2024-04-26T22:03:59.427746+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.427746+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:43.368454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'1931","reported_seq":1968,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:13.754999+0000","last_change":"2024-04-26T22:04:13.755064+0000","last_active":"2024-04-26T22:04:13.754999+0000","last_peered":"2024-04-26T22:04:13.754999+0000","last_clean":"2024-04-26T22:04:13.754999+0000","last_became_active":"2024-04-26T21:37:21.496026+0000","last_became_peered":"2024-04-26T21:37:21.496026+0000","last_unstale":"2024-04-26T22:04:13.754999+0000","last_undegraded":"2024-04-26T22:04:13.754999+0000","last_fullsized":"2024-04-26T22:04:13.754999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1931","last_scrub_stamp":"2024-04-26T22:04:13.754788+0000","last_deep_scrub":"26'1931","last_deep_scrub_stamp":"2024-04-26T22:04:13.754788+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.754788+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:28.890549+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1423,"num_write_kb":55204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'524","reported_seq":569,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.313562+0000","last_change":"2024-04-26T22:04:05.313621+0000","last_active":"2024-04-26T22:04:05.313562+0000","last_peered":"2024-04-26T22:04:05.313562+0000","last_clean":"2024-04-26T22:04:05.313562+0000","last_became_active":"2024-04-26T21:37:17.450153+0000","last_became_peered":"2024-04-26T21:37:17.450153+0000","last_unstale":"2024-04-26T22:04:05.313562+0000","last_undegraded":"2024-04-26T22:04:05.313562+0000","last_fullsized":"2024-04-26T22:04:05.313562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'524","last_scrub_stamp":"2024-04-26T22:04:05.313379+0000","last_deep_scrub":"26'524","last_deep_scrub_stamp":"2024-04-26T22:04:05.313379+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.313379+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:39:45.451252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'551","reported_seq":596,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.604987+0000","last_change":"2024-04-26T22:03:59.605114+0000","last_active":"2024-04-26T22:03:59.604987+0000","last_peered":"2024-04-26T22:03:59.604987+0000","last_clean":"2024-04-26T22:03:59.604987+0000","last_became_active":"2024-04-26T21:37:17.454396+0000","last_became_peered":"2024-04-26T21:37:17.454396+0000","last_unstale":"2024-04-26T22:03:59.604987+0000","last_undegraded":"2024-04-26T22:03:59.604987+0000","last_fullsized":"2024-04-26T22:03:59.604987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'551","last_scrub_stamp":"2024-04-26T22:03:59.604782+0000","last_deep_scrub":"26'551","last_deep_scrub_stamp":"2024-04-26T22:03:59.604782+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.604782+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:12.991266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'499","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.932932+0000","last_change":"2024-04-26T22:04:02.932994+0000","last_active":"2024-04-26T22:04:02.932932+0000","last_peered":"2024-04-26T22:04:02.932932+0000","last_clean":"2024-04-26T22:04:02.932932+0000","last_became_active":"2024-04-26T21:37:17.433682+0000","last_became_peered":"2024-04-26T21:37:17.433682+0000","last_unstale":"2024-04-26T22:04:02.932932+0000","last_undegraded":"2024-04-26T22:04:02.932932+0000","last_fullsized":"2024-04-26T22:04:02.932932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'499","last_scrub_stamp":"2024-04-26T22:04:02.932707+0000","last_deep_scrub":"26'499","last_deep_scrub_stamp":"2024-04-26T22:04:02.932707+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.932707+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:38.555381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'508","reported_seq":553,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:59.663996+0000","last_change":"2024-04-26T22:03:59.664128+0000","last_active":"2024-04-26T22:03:59.663996+0000","last_peered":"2024-04-26T22:03:59.663996+0000","last_clean":"2024-04-26T22:03:59.663996+0000","last_became_active":"2024-04-26T21:37:17.437294+0000","last_became_peered":"2024-04-26T21:37:17.437294+0000","last_unstale":"2024-04-26T22:03:59.663996+0000","last_undegraded":"2024-04-26T22:03:59.663996+0000","last_fullsized":"2024-04-26T22:03:59.663996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'508","last_scrub_stamp":"2024-04-26T22:03:59.663787+0000","last_deep_scrub":"26'508","last_deep_scrub_stamp":"2024-04-26T22:03:59.663787+0000","last_clean_scrub_stamp":"2024-04-26T22:03:59.663787+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:07.183866+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'476","reported_seq":521,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.652715+0000","last_change":"2024-04-26T22:04:03.652779+0000","last_active":"2024-04-26T22:04:03.652715+0000","last_peered":"2024-04-26T22:04:03.652715+0000","last_clean":"2024-04-26T22:04:03.652715+0000","last_became_active":"2024-04-26T21:37:17.427756+0000","last_became_peered":"2024-04-26T21:37:17.427756+0000","last_unstale":"2024-04-26T22:04:03.652715+0000","last_undegraded":"2024-04-26T22:04:03.652715+0000","last_fullsized":"2024-04-26T22:04:03.652715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'476","last_scrub_stamp":"2024-04-26T22:04:03.652511+0000","last_deep_scrub":"26'476","last_deep_scrub_stamp":"2024-04-26T22:04:03.652511+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.652511+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:59:51.042059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'489","reported_seq":534,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.114060+0000","last_change":"2024-04-26T22:04:03.114183+0000","last_active":"2024-04-26T22:04:03.114060+0000","last_peered":"2024-04-26T22:04:03.114060+0000","last_clean":"2024-04-26T22:04:03.114060+0000","last_became_active":"2024-04-26T21:37:17.432104+0000","last_became_peered":"2024-04-26T21:37:17.432104+0000","last_unstale":"2024-04-26T22:04:03.114060+0000","last_undegraded":"2024-04-26T22:04:03.114060+0000","last_fullsized":"2024-04-26T22:04:03.114060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'489","last_scrub_stamp":"2024-04-26T22:04:03.113776+0000","last_deep_scrub":"26'489","last_deep_scrub_stamp":"2024-04-26T22:04:03.113776+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.113776+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:19.991915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'522","reported_seq":567,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:04.313391+0000","last_change":"2024-04-26T22:04:04.313453+0000","last_active":"2024-04-26T22:04:04.313391+0000","last_peered":"2024-04-26T22:04:04.313391+0000","last_clean":"2024-04-26T22:04:04.313391+0000","last_became_active":"2024-04-26T21:37:17.445973+0000","last_became_peered":"2024-04-26T21:37:17.445973+0000","last_unstale":"2024-04-26T22:04:04.313391+0000","last_undegraded":"2024-04-26T22:04:04.313391+0000","last_fullsized":"2024-04-26T22:04:04.313391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'522","last_scrub_stamp":"2024-04-26T22:04:04.313209+0000","last_deep_scrub":"26'522","last_deep_scrub_stamp":"2024-04-26T22:04:04.313209+0000","last_clean_scrub_stamp":"2024-04-26T22:04:04.313209+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:09.821082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'475","reported_seq":520,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:06.710430+0000","last_change":"2024-04-26T22:04:06.710489+0000","last_active":"2024-04-26T22:04:06.710430+0000","last_peered":"2024-04-26T22:04:06.710430+0000","last_clean":"2024-04-26T22:04:06.710430+0000","last_became_active":"2024-04-26T21:37:17.446808+0000","last_became_peered":"2024-04-26T21:37:17.446808+0000","last_unstale":"2024-04-26T22:04:06.710430+0000","last_undegraded":"2024-04-26T22:04:06.710430+0000","last_fullsized":"2024-04-26T22:04:06.710430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'475","last_scrub_stamp":"2024-04-26T22:04:06.710255+0000","last_deep_scrub":"26'475","last_deep_scrub_stamp":"2024-04-26T22:04:06.710255+0000","last_clean_scrub_stamp":"2024-04-26T22:04:06.710255+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:52:04.370499+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'513","reported_seq":544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:11.188777+0000","last_change":"2024-04-26T22:04:11.188836+0000","last_active":"2024-04-26T22:04:11.188777+0000","last_peered":"2024-04-26T22:04:11.188777+0000","last_clean":"2024-04-26T22:04:11.188777+0000","last_became_active":"2024-04-26T21:37:58.749833+0000","last_became_peered":"2024-04-26T21:37:58.749833+0000","last_unstale":"2024-04-26T22:04:11.188777+0000","last_undegraded":"2024-04-26T22:04:11.188777+0000","last_fullsized":"2024-04-26T22:04:11.188777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'513","last_scrub_stamp":"2024-04-26T22:04:11.188605+0000","last_deep_scrub":"26'513","last_deep_scrub_stamp":"2024-04-26T22:04:11.188605+0000","last_clean_scrub_stamp":"2024-04-26T22:04:11.188605+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:05.514354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"26'482","reported_seq":526,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:04.683717+0000","last_change":"2024-04-26T22:04:04.683777+0000","last_active":"2024-04-26T22:04:04.683717+0000","last_peered":"2024-04-26T22:04:04.683717+0000","last_clean":"2024-04-26T22:04:04.683717+0000","last_became_active":"2024-04-26T21:37:17.432694+0000","last_became_peered":"2024-04-26T21:37:17.432694+0000","last_unstale":"2024-04-26T22:04:04.683717+0000","last_undegraded":"2024-04-26T22:04:04.683717+0000","last_fullsized":"2024-04-26T22:04:04.683717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'482","last_scrub_stamp":"2024-04-26T22:04:04.683491+0000","last_deep_scrub":"26'482","last_deep_scrub_stamp":"2024-04-26T22:04:04.683491+0000","last_clean_scrub_stamp":"2024-04-26T22:04:04.683491+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:39.565732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'530","reported_seq":574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.996935+0000","last_change":"2024-04-26T22:04:07.996999+0000","last_active":"2024-04-26T22:04:07.996935+0000","last_peered":"2024-04-26T22:04:07.996935+0000","last_clean":"2024-04-26T22:04:07.996935+0000","last_became_active":"2024-04-26T21:37:17.449605+0000","last_became_peered":"2024-04-26T21:37:17.449605+0000","last_unstale":"2024-04-26T22:04:07.996935+0000","last_undegraded":"2024-04-26T22:04:07.996935+0000","last_fullsized":"2024-04-26T22:04:07.996935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'530","last_scrub_stamp":"2024-04-26T22:04:07.996744+0000","last_deep_scrub":"26'530","last_deep_scrub_stamp":"2024-04-26T22:04:07.996744+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.996744+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:42.878985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'488","reported_seq":532,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:53.662483+0000","last_change":"2024-04-26T22:03:53.662517+0000","last_active":"2024-04-26T22:03:53.662483+0000","last_peered":"2024-04-26T22:03:53.662483+0000","last_clean":"2024-04-26T22:03:53.662483+0000","last_became_active":"2024-04-26T21:37:17.438006+0000","last_became_peered":"2024-04-26T21:37:17.438006+0000","last_unstale":"2024-04-26T22:03:53.662483+0000","last_undegraded":"2024-04-26T22:03:53.662483+0000","last_fullsized":"2024-04-26T22:03:53.662483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'488","last_scrub_stamp":"2024-04-26T22:03:53.662384+0000","last_deep_scrub":"26'488","last_deep_scrub_stamp":"2024-04-26T22:03:53.662384+0000","last_clean_scrub_stamp":"2024-04-26T22:03:53.662384+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:54.185519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'512","reported_seq":556,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:03.346833+0000","last_change":"2024-04-26T22:04:03.346974+0000","last_active":"2024-04-26T22:04:03.346833+0000","last_peered":"2024-04-26T22:04:03.346833+0000","last_clean":"2024-04-26T22:04:03.346833+0000","last_became_active":"2024-04-26T21:37:17.444548+0000","last_became_peered":"2024-04-26T21:37:17.444548+0000","last_unstale":"2024-04-26T22:04:03.346833+0000","last_undegraded":"2024-04-26T22:04:03.346833+0000","last_fullsized":"2024-04-26T22:04:03.346833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'512","last_scrub_stamp":"2024-04-26T22:04:03.346613+0000","last_deep_scrub":"26'512","last_deep_scrub_stamp":"2024-04-26T22:04:03.346613+0000","last_clean_scrub_stamp":"2024-04-26T22:04:03.346613+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:13:20.833834+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'505","reported_seq":549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.446053+0000","last_change":"2024-04-26T22:04:07.446112+0000","last_active":"2024-04-26T22:04:07.446053+0000","last_peered":"2024-04-26T22:04:07.446053+0000","last_clean":"2024-04-26T22:04:07.446053+0000","last_became_active":"2024-04-26T21:37:17.440990+0000","last_became_peered":"2024-04-26T21:37:17.440990+0000","last_unstale":"2024-04-26T22:04:07.446053+0000","last_undegraded":"2024-04-26T22:04:07.446053+0000","last_fullsized":"2024-04-26T22:04:07.446053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'505","last_scrub_stamp":"2024-04-26T22:04:07.445846+0000","last_deep_scrub":"26'505","last_deep_scrub_stamp":"2024-04-26T22:04:07.445846+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.445846+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:59:54.835394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'459","reported_seq":503,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.612670+0000","last_change":"2024-04-26T22:03:58.612713+0000","last_active":"2024-04-26T22:03:58.612670+0000","last_peered":"2024-04-26T22:03:58.612670+0000","last_clean":"2024-04-26T22:03:58.612670+0000","last_became_active":"2024-04-26T21:37:17.445699+0000","last_became_peered":"2024-04-26T21:37:17.445699+0000","last_unstale":"2024-04-26T22:03:58.612670+0000","last_undegraded":"2024-04-26T22:03:58.612670+0000","last_fullsized":"2024-04-26T22:03:58.612670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'459","last_scrub_stamp":"2024-04-26T22:03:58.612552+0000","last_deep_scrub":"26'459","last_deep_scrub_stamp":"2024-04-26T22:03:58.612552+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.612552+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:51.286402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'525","reported_seq":569,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:07.049369+0000","last_change":"2024-04-26T22:04:07.049491+0000","last_active":"2024-04-26T22:04:07.049369+0000","last_peered":"2024-04-26T22:04:07.049369+0000","last_clean":"2024-04-26T22:04:07.049369+0000","last_became_active":"2024-04-26T21:37:17.448747+0000","last_became_peered":"2024-04-26T21:37:17.448747+0000","last_unstale":"2024-04-26T22:04:07.049369+0000","last_undegraded":"2024-04-26T22:04:07.049369+0000","last_fullsized":"2024-04-26T22:04:07.049369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'525","last_scrub_stamp":"2024-04-26T22:04:07.049155+0000","last_deep_scrub":"26'525","last_deep_scrub_stamp":"2024-04-26T22:04:07.049155+0000","last_clean_scrub_stamp":"2024-04-26T22:04:07.049155+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:59:54.438703+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'520","reported_seq":564,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:11.001221+0000","last_change":"2024-04-26T22:04:11.001285+0000","last_active":"2024-04-26T22:04:11.001221+0000","last_peered":"2024-04-26T22:04:11.001221+0000","last_clean":"2024-04-26T22:04:11.001221+0000","last_became_active":"2024-04-26T21:37:17.450515+0000","last_became_peered":"2024-04-26T21:37:17.450515+0000","last_unstale":"2024-04-26T22:04:11.001221+0000","last_undegraded":"2024-04-26T22:04:11.001221+0000","last_fullsized":"2024-04-26T22:04:11.001221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'520","last_scrub_stamp":"2024-04-26T22:04:11.001054+0000","last_deep_scrub":"26'520","last_deep_scrub_stamp":"2024-04-26T22:04:11.001054+0000","last_clean_scrub_stamp":"2024-04-26T22:04:11.001054+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:26.059209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'505","reported_seq":549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.107106+0000","last_change":"2024-04-26T22:04:02.107166+0000","last_active":"2024-04-26T22:04:02.107106+0000","last_peered":"2024-04-26T22:04:02.107106+0000","last_clean":"2024-04-26T22:04:02.107106+0000","last_became_active":"2024-04-26T21:37:17.428218+0000","last_became_peered":"2024-04-26T21:37:17.428218+0000","last_unstale":"2024-04-26T22:04:02.107106+0000","last_undegraded":"2024-04-26T22:04:02.107106+0000","last_fullsized":"2024-04-26T22:04:02.107106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'505","last_scrub_stamp":"2024-04-26T22:04:02.106932+0000","last_deep_scrub":"26'505","last_deep_scrub_stamp":"2024-04-26T22:04:02.106932+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.106932+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:34.855650+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'510","reported_seq":554,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.700528+0000","last_change":"2024-04-26T22:04:01.700683+0000","last_active":"2024-04-26T22:04:01.700528+0000","last_peered":"2024-04-26T22:04:01.700528+0000","last_clean":"2024-04-26T22:04:01.700528+0000","last_became_active":"2024-04-26T21:37:17.437959+0000","last_became_peered":"2024-04-26T21:37:17.437959+0000","last_unstale":"2024-04-26T22:04:01.700528+0000","last_undegraded":"2024-04-26T22:04:01.700528+0000","last_fullsized":"2024-04-26T22:04:01.700528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'510","last_scrub_stamp":"2024-04-26T22:04:01.700314+0000","last_deep_scrub":"26'510","last_deep_scrub_stamp":"2024-04-26T22:04:01.700314+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.700314+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:21.236417+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'476","reported_seq":520,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:58.689274+0000","last_change":"2024-04-26T22:03:58.689299+0000","last_active":"2024-04-26T22:03:58.689274+0000","last_peered":"2024-04-26T22:03:58.689274+0000","last_clean":"2024-04-26T22:03:58.689274+0000","last_became_active":"2024-04-26T21:37:17.446963+0000","last_became_peered":"2024-04-26T21:37:17.446963+0000","last_unstale":"2024-04-26T22:03:58.689274+0000","last_undegraded":"2024-04-26T22:03:58.689274+0000","last_fullsized":"2024-04-26T22:03:58.689274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'476","last_scrub_stamp":"2024-04-26T22:03:58.689189+0000","last_deep_scrub":"26'476","last_deep_scrub_stamp":"2024-04-26T22:03:58.689189+0000","last_clean_scrub_stamp":"2024-04-26T22:03:58.689189+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:39:38.827062+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'494","reported_seq":538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:01.433927+0000","last_change":"2024-04-26T22:04:01.433988+0000","last_active":"2024-04-26T22:04:01.433927+0000","last_peered":"2024-04-26T22:04:01.433927+0000","last_clean":"2024-04-26T22:04:01.433927+0000","last_became_active":"2024-04-26T21:37:17.447157+0000","last_became_peered":"2024-04-26T21:37:17.447157+0000","last_unstale":"2024-04-26T22:04:01.433927+0000","last_undegraded":"2024-04-26T22:04:01.433927+0000","last_fullsized":"2024-04-26T22:04:01.433927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'494","last_scrub_stamp":"2024-04-26T22:04:01.433709+0000","last_deep_scrub":"26'494","last_deep_scrub_stamp":"2024-04-26T22:04:01.433709+0000","last_clean_scrub_stamp":"2024-04-26T22:04:01.433709+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:29.146736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'475","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:08.341298+0000","last_change":"2024-04-26T22:04:08.341415+0000","last_active":"2024-04-26T22:04:08.341298+0000","last_peered":"2024-04-26T22:04:08.341298+0000","last_clean":"2024-04-26T22:04:08.341298+0000","last_became_active":"2024-04-26T21:37:17.458138+0000","last_became_peered":"2024-04-26T21:37:17.458138+0000","last_unstale":"2024-04-26T22:04:08.341298+0000","last_undegraded":"2024-04-26T22:04:08.341298+0000","last_fullsized":"2024-04-26T22:04:08.341298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'475","last_scrub_stamp":"2024-04-26T22:04:08.341096+0000","last_deep_scrub":"26'475","last_deep_scrub_stamp":"2024-04-26T22:04:08.341096+0000","last_clean_scrub_stamp":"2024-04-26T22:04:08.341096+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:41.089813+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'485","reported_seq":529,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:09.370975+0000","last_change":"2024-04-26T22:04:09.371033+0000","last_active":"2024-04-26T22:04:09.370975+0000","last_peered":"2024-04-26T22:04:09.370975+0000","last_clean":"2024-04-26T22:04:09.370975+0000","last_became_active":"2024-04-26T21:37:17.458345+0000","last_became_peered":"2024-04-26T21:37:17.458345+0000","last_unstale":"2024-04-26T22:04:09.370975+0000","last_undegraded":"2024-04-26T22:04:09.370975+0000","last_fullsized":"2024-04-26T22:04:09.370975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'485","last_scrub_stamp":"2024-04-26T22:04:09.370774+0000","last_deep_scrub":"26'485","last_deep_scrub_stamp":"2024-04-26T22:04:09.370774+0000","last_clean_scrub_stamp":"2024-04-26T22:04:09.370774+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:26.248914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'506","reported_seq":550,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:13.418843+0000","last_change":"2024-04-26T22:04:13.418956+0000","last_active":"2024-04-26T22:04:13.418843+0000","last_peered":"2024-04-26T22:04:13.418843+0000","last_clean":"2024-04-26T22:04:13.418843+0000","last_became_active":"2024-04-26T21:37:17.458710+0000","last_became_peered":"2024-04-26T21:37:17.458710+0000","last_unstale":"2024-04-26T22:04:13.418843+0000","last_undegraded":"2024-04-26T22:04:13.418843+0000","last_fullsized":"2024-04-26T22:04:13.418843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'506","last_scrub_stamp":"2024-04-26T22:04:13.418666+0000","last_deep_scrub":"26'506","last_deep_scrub_stamp":"2024-04-26T22:04:13.418666+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.418666+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:10.628345+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'470","reported_seq":499,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.588882+0000","last_change":"2024-04-26T22:04:02.588942+0000","last_active":"2024-04-26T22:04:02.588882+0000","last_peered":"2024-04-26T22:04:02.588882+0000","last_clean":"2024-04-26T22:04:02.588882+0000","last_became_active":"2024-04-26T21:37:59.070372+0000","last_became_peered":"2024-04-26T21:37:59.070372+0000","last_unstale":"2024-04-26T22:04:02.588882+0000","last_undegraded":"2024-04-26T22:04:02.588882+0000","last_fullsized":"2024-04-26T22:04:02.588882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'470","last_scrub_stamp":"2024-04-26T22:04:02.588715+0000","last_deep_scrub":"26'470","last_deep_scrub_stamp":"2024-04-26T22:04:02.588715+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.588715+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:13:51.920899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"26'485","reported_seq":528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:09.445308+0000","last_change":"2024-04-26T22:04:09.445370+0000","last_active":"2024-04-26T22:04:09.445308+0000","last_peered":"2024-04-26T22:04:09.445308+0000","last_clean":"2024-04-26T22:04:09.445308+0000","last_became_active":"2024-04-26T21:37:17.448911+0000","last_became_peered":"2024-04-26T21:37:17.448911+0000","last_unstale":"2024-04-26T22:04:09.445308+0000","last_undegraded":"2024-04-26T22:04:09.445308+0000","last_fullsized":"2024-04-26T22:04:09.445308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'485","last_scrub_stamp":"2024-04-26T22:04:09.445077+0000","last_deep_scrub":"26'485","last_deep_scrub_stamp":"2024-04-26T22:04:09.445077+0000","last_clean_scrub_stamp":"2024-04-26T22:04:09.445077+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:00.189570+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'482","reported_seq":525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:03:56.936935+0000","last_change":"2024-04-26T22:03:56.936996+0000","last_active":"2024-04-26T22:03:56.936935+0000","last_peered":"2024-04-26T22:03:56.936935+0000","last_clean":"2024-04-26T22:03:56.936935+0000","last_became_active":"2024-04-26T21:37:17.448457+0000","last_became_peered":"2024-04-26T21:37:17.448457+0000","last_unstale":"2024-04-26T22:03:56.936935+0000","last_undegraded":"2024-04-26T22:03:56.936935+0000","last_fullsized":"2024-04-26T22:03:56.936935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'482","last_scrub_stamp":"2024-04-26T22:03:56.936726+0000","last_deep_scrub":"26'482","last_deep_scrub_stamp":"2024-04-26T22:03:56.936726+0000","last_clean_scrub_stamp":"2024-04-26T22:03:56.936726+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:14.334657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'509","reported_seq":552,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:08.424090+0000","last_change":"2024-04-26T22:04:08.424149+0000","last_active":"2024-04-26T22:04:08.424090+0000","last_peered":"2024-04-26T22:04:08.424090+0000","last_clean":"2024-04-26T22:04:08.424090+0000","last_became_active":"2024-04-26T21:37:17.445196+0000","last_became_peered":"2024-04-26T21:37:17.445196+0000","last_unstale":"2024-04-26T22:04:08.424090+0000","last_undegraded":"2024-04-26T22:04:08.424090+0000","last_fullsized":"2024-04-26T22:04:08.424090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'509","last_scrub_stamp":"2024-04-26T22:04:08.423908+0000","last_deep_scrub":"26'509","last_deep_scrub_stamp":"2024-04-26T22:04:08.423908+0000","last_clean_scrub_stamp":"2024-04-26T22:04:08.423908+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:43.306148+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'509","reported_seq":555,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:08.963037+0000","last_change":"2024-04-26T22:04:08.963096+0000","last_active":"2024-04-26T22:04:08.963037+0000","last_peered":"2024-04-26T22:04:08.963037+0000","last_clean":"2024-04-26T22:04:08.963037+0000","last_became_active":"2024-04-26T21:37:17.444198+0000","last_became_peered":"2024-04-26T21:37:17.444198+0000","last_unstale":"2024-04-26T22:04:08.963037+0000","last_undegraded":"2024-04-26T22:04:08.963037+0000","last_fullsized":"2024-04-26T22:04:08.963037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'509","last_scrub_stamp":"2024-04-26T22:04:08.962839+0000","last_deep_scrub":"26'509","last_deep_scrub_stamp":"2024-04-26T22:04:08.962839+0000","last_clean_scrub_stamp":"2024-04-26T22:04:08.962839+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.707332+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'488","reported_seq":533,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:02.674213+0000","last_change":"2024-04-26T22:04:02.674281+0000","last_active":"2024-04-26T22:04:02.674213+0000","last_peered":"2024-04-26T22:04:02.674213+0000","last_clean":"2024-04-26T22:04:02.674213+0000","last_became_active":"2024-04-26T21:37:17.443028+0000","last_became_peered":"2024-04-26T21:37:17.443028+0000","last_unstale":"2024-04-26T22:04:02.674213+0000","last_undegraded":"2024-04-26T22:04:02.674213+0000","last_fullsized":"2024-04-26T22:04:02.674213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'488","last_scrub_stamp":"2024-04-26T22:04:02.673941+0000","last_deep_scrub":"26'488","last_deep_scrub_stamp":"2024-04-26T22:04:02.673941+0000","last_clean_scrub_stamp":"2024-04-26T22:04:02.673941+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:35.422658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'487","reported_seq":532,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:05.197141+0000","last_change":"2024-04-26T22:04:05.197203+0000","last_active":"2024-04-26T22:04:05.197141+0000","last_peered":"2024-04-26T22:04:05.197141+0000","last_clean":"2024-04-26T22:04:05.197141+0000","last_became_active":"2024-04-26T21:37:17.446399+0000","last_became_peered":"2024-04-26T21:37:17.446399+0000","last_unstale":"2024-04-26T22:04:05.197141+0000","last_undegraded":"2024-04-26T22:04:05.197141+0000","last_fullsized":"2024-04-26T22:04:05.197141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'487","last_scrub_stamp":"2024-04-26T22:04:05.196959+0000","last_deep_scrub":"26'487","last_deep_scrub_stamp":"2024-04-26T22:04:05.196959+0000","last_clean_scrub_stamp":"2024-04-26T22:04:05.196959+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:40.079199+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'477","reported_seq":522,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T22:04:14.387394+0000","last_change":"2024-04-26T22:04:14.387457+0000","last_active":"2024-04-26T22:04:14.387394+0000","last_peered":"2024-04-26T22:04:14.387394+0000","last_clean":"2024-04-26T22:04:14.387394+0000","last_became_active":"2024-04-26T21:37:17.460553+0000","last_became_peered":"2024-04-26T21:37:17.460553+0000","last_unstale":"2024-04-26T22:04:14.387394+0000","last_undegraded":"2024-04-26T22:04:14.387394+0000","last_fullsized":"2024-04-26T22:04:14.387394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'477","last_scrub_stamp":"2024-04-26T22:04:14.387208+0000","last_deep_scrub":"26'477","last_deep_scrub_stamp":"2024-04-26T22:04:14.387208+0000","last_clean_scrub_stamp":"2024-04-26T22:04:14.387208+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:08.712957+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52831,"num_write_kb":2071742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68463,"ondisk_log_size":68463,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31956,"ondisk_log_size":31956,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":240165372,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2679,"num_read_kb":5245,"num_write":58367,"num_write_kb":440918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5447,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":480387072,"data_stored":480330744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55490,"ondisk_log_size":55490,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575176,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279712,"kb_used_data":50008,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94092128,"statfs":{"total":96636764160,"available":96350339072,"internally_reserved":0,"allocated":51208192,"data_stored":51036951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575176,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325156,"kb_used_data":63580,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94046684,"statfs":{"total":96636764160,"available":96303804416,"internally_reserved":0,"allocated":65105920,"data_stored":64933386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575177,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":69908,"kb_used_omap":1,"kb_used_meta":233726,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":71585792,"data_stored":71417611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239335877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575177,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309348,"kb_used_data":65820,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94062492,"statfs":{"total":96636764160,"available":96319991808,"internally_reserved":0,"allocated":67399680,"data_stored":67223343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249362886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575176,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397252,"kb_used_data":73212,"kb_used_omap":1,"kb_used_meta":324030,"kb_avail":93974588,"statfs":{"total":96636764160,"available":96229978112,"internally_reserved":0,"allocated":74969088,"data_stored":74797270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":331807175},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575178,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211836,"kb_used_data":36340,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94160004,"statfs":{"total":96636764160,"available":96419844096,"internally_reserved":0,"allocated":37212160,"data_stored":37047862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431844,"kb_used_data":75868,"kb_used_omap":1,"kb_used_meta":355966,"kb_avail":93939996,"statfs":{"total":96636764160,"available":96194555904,"internally_reserved":0,"allocated":77688832,"data_stored":77515786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":364509638},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575176,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257640,"kb_used_data":37728,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94114200,"statfs":{"total":96636764160,"available":96372940800,"internally_reserved":0,"allocated":38633472,"data_stored":38454095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225180102},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37761024,"data_stored":37749374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77410304,"data_stored":77401433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36933632,"data_stored":36933509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74690560,"data_stored":74682917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":67121152,"data_stored":67108990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64827392,"data_stored":64819033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:04:19.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T22:04:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.448+0000 7f636e000640 1 Processor -- start 2024-04-26T22:04:19.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.448+0000 7f636e000640 1 -- start start 2024-04-26T22:04:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.449+0000 7f636e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b69b0 0x7f6368148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.449+0000 7f636e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63681421a0 0x7f6368142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.449+0000 7f636e000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63680b8bf0 con 0x7f63680b87d0 2024-04-26T22:04:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.449+0000 7f636e000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f63680b6d90 con 0x7f63681421a0 2024-04-26T22:04:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.449+0000 7f636e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f63681487d0 con 0x7f63680b69b0 2024-04-26T22:04:19.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63681421a0 0x7f6368142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63681421a0 0x7f6368142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34286/0 (socket says 172.21.15.5:34286) 2024-04-26T22:04:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636d600640 1 -- 172.21.15.5:0/164359093 learned_addr learned my addr 172.21.15.5:0/164359093 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636cc00640 1 --2- 172.21.15.5:0/164359093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b69b0 0x7f6368148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636d600640 1 -- 172.21.15.5:0/164359093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b69b0 msgr2=0x7f6368148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636d600640 1 --2- 172.21.15.5:0/164359093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b69b0 0x7f6368148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636d600640 1 -- 172.21.15.5:0/164359093 >> v1:172.21.15.112:6789/0 conn(0x7f63680b87d0 legacy=0x7f63680b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:19.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.450+0000 7f636d600640 1 -- 172.21.15.5:0/164359093 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6368148ab0 con 0x7f63681421a0 2024-04-26T22:04:19.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.451+0000 7f636d600640 1 --2- 172.21.15.5:0/164359093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63681421a0 0x7f6368142610 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6360009870 tx=0x7f636002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdd131056ac6a63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:19.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.452+0000 7f6367400640 1 -- 172.21.15.5:0/164359093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360037070 con 0x7f63681421a0 2024-04-26T22:04:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.452+0000 7f6367400640 1 -- 172.21.15.5:0/164359093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6360032440 con 0x7f63681421a0 2024-04-26T22:04:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.452+0000 7f6367400640 1 -- 172.21.15.5:0/164359093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360032810 con 0x7f63681421a0 2024-04-26T22:04:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.452+0000 7f636e000640 1 -- 172.21.15.5:0/164359093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63681421a0 msgr2=0x7f6368142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.452+0000 7f636e000640 1 --2- 172.21.15.5:0/164359093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63681421a0 0x7f6368142610 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6360009870 tx=0x7f636002a270 comp rx=0 tx=0).stop 2024-04-26T22:04:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.452+0000 7f636e000640 1 -- 172.21.15.5:0/164359093 shutdown_connections 2024-04-26T22:04:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.453+0000 7f636e000640 1 --2- 172.21.15.5:0/164359093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63681421a0 0x7f6368142610 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.453+0000 7f636e000640 1 --2- 172.21.15.5:0/164359093 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b69b0 0x7f6368148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.453+0000 7f636e000640 1 -- 172.21.15.5:0/164359093 >> 172.21.15.5:0/164359093 conn(0x7f63680bde50 msgr2=0x7f63680be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.453+0000 7f636e000640 1 -- 172.21.15.5:0/164359093 shutdown_connections 2024-04-26T22:04:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.453+0000 7f636e000640 1 -- 172.21.15.5:0/164359093 wait complete. 2024-04-26T22:04:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.454+0000 7f636e000640 1 Processor -- start 2024-04-26T22:04:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.454+0000 7f636e000640 1 -- start start 2024-04-26T22:04:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.455+0000 7f636e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63680b69b0 0x7f636814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.455+0000 7f636e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b87d0 0x7f63681e1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.455+0000 7f636e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63681421a0 0x7f63681e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.455+0000 7f636e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f63680ba5a0 con 0x7f63680b69b0 2024-04-26T22:04:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.455+0000 7f636e000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f63681484a0 con 0x7f63681421a0 2024-04-26T22:04:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.455+0000 7f636e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f63680ba720 con 0x7f63680b87d0 2024-04-26T22:04:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63680b69b0 0x7f636814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63680b69b0 0x7f636814bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34294/0 (socket says 172.21.15.5:34294) 2024-04-26T22:04:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 -- 172.21.15.5:0/4103278157 learned_addr learned my addr 172.21.15.5:0/4103278157 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f6367e00640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b87d0 0x7f63681e1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636d600640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63681421a0 0x7f63681e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 -- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b87d0 msgr2=0x7f63681e1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b87d0 0x7f63681e1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 -- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63681421a0 msgr2=0x7f63681e1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63681421a0 0x7f63681e1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.456+0000 7f636cc00640 1 -- 172.21.15.5:0/4103278157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6368145a50 con 0x7f63680b69b0 2024-04-26T22:04:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.457+0000 7f636cc00640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63680b69b0 0x7f636814bbb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6358007f20 tx=0x7f635800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.457+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358014620 con 0x7f63680b69b0 2024-04-26T22:04:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.457+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6358019070 con 0x7f63680b69b0 2024-04-26T22:04:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.457+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358014a00 con 0x7f63680b69b0 2024-04-26T22:04:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.457+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636814c6b0 con 0x7f63680b69b0 2024-04-26T22:04:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.457+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63681d2870 con 0x7f63680b69b0 2024-04-26T22:04:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.458+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6368075db0 con 0x7f63680b69b0 2024-04-26T22:04:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.459+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6358014ba0 con 0x7f63680b69b0 2024-04-26T22:04:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.460+0000 7f6364c00640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f634806c8f0 0x7f634806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.460+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f635808c8a0 con 0x7f63680b69b0 2024-04-26T22:04:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.461+0000 7f6367e00640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f634806c8f0 0x7f634806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.462+0000 7f6367e00640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f634806c8f0 0x7f634806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63680b4fd0 tx=0x7f6354009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.465+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f635805a8c0 con 0x7f63680b69b0 2024-04-26T22:04:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.670+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f63681e1370 con 0x7f63680b69b0 2024-04-26T22:04:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.677+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f635805a1c0 con 0x7f63680b69b0 2024-04-26T22:04:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.678+0000 7f6364c00640 1 -- 172.21.15.5:0/4103278157 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6358092080 con 0x7f63680b69b0 2024-04-26T22:04:19.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f634806c8f0 msgr2=0x7f634806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f634806c8f0 0x7f634806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f63680b4fd0 tx=0x7f6354009040 comp rx=0 tx=0).stop 2024-04-26T22:04:19.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63680b69b0 msgr2=0x7f636814bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63680b69b0 0x7f636814bbb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6358007f20 tx=0x7f635800e570 comp rx=0 tx=0).stop 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 shutdown_connections 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63681421a0 0x7f63681e1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63680b87d0 0x7f63681e1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f634806c8f0 0x7f634806edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 --2- 172.21.15.5:0/4103278157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63680b69b0 0x7f636814bbb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 >> 172.21.15.5:0/4103278157 conn(0x7f63680bde50 msgr2=0x7f636813f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 shutdown_connections 2024-04-26T22:04:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.680+0000 7f636e000640 1 -- 172.21.15.5:0/4103278157 wait complete. 2024-04-26T22:04:19.701 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:04:19.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:19.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.891+0000 7f86b9400640 1 Processor -- start 2024-04-26T22:04:19.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.892+0000 7f86b9400640 1 -- start start 2024-04-26T22:04:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.893+0000 7f86b9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b414bdc0 0x7f86b40b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.893+0000 7f86b9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f86b40b3300 0x7f86b40b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.893+0000 7f86b9400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b414c1a0 con 0x7f86b4073590 2024-04-26T22:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.893+0000 7f86b9400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f86b414ca10 con 0x7f86b414bdc0 2024-04-26T22:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.893+0000 7f86b9400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f86b40aea20 con 0x7f86b40b3300 2024-04-26T22:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b414bdc0 0x7f86b40b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b414bdc0 0x7f86b40b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34310/0 (socket says 172.21.15.5:34310) 2024-04-26T22:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3e00640 1 -- 172.21.15.5:0/3429158540 learned_addr learned my addr 172.21.15.5:0/3429158540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3400640 1 --2- 172.21.15.5:0/3429158540 >> v2:172.21.15.112:3300/0 conn(0x7f86b40b3300 0x7f86b40b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3e00640 1 -- 172.21.15.5:0/3429158540 >> v2:172.21.15.112:3300/0 conn(0x7f86b40b3300 msgr2=0x7f86b40b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3e00640 1 --2- 172.21.15.5:0/3429158540 >> v2:172.21.15.112:3300/0 conn(0x7f86b40b3300 0x7f86b40b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3e00640 1 -- 172.21.15.5:0/3429158540 >> v1:172.21.15.112:6789/0 conn(0x7f86b4073590 legacy=0x7f86b4073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.894+0000 7f86b3e00640 1 -- 172.21.15.5:0/3429158540 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b414c450 con 0x7f86b414bdc0 2024-04-26T22:04:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.896+0000 7f86b3e00640 1 --2- 172.21.15.5:0/3429158540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b414bdc0 0x7f86b40b46c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f86b40744c0 tx=0x7f86a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919af1916069a975 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.896+0000 7f86b2a00640 1 -- 172.21.15.5:0/3429158540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4037070 con 0x7f86b414bdc0 2024-04-26T22:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.896+0000 7f86b2a00640 1 -- 172.21.15.5:0/3429158540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f86a4032440 con 0x7f86b414bdc0 2024-04-26T22:04:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.896+0000 7f86b2a00640 1 -- 172.21.15.5:0/3429158540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4032830 con 0x7f86b414bdc0 2024-04-26T22:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 -- 172.21.15.5:0/3429158540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b414bdc0 msgr2=0x7f86b40b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 --2- 172.21.15.5:0/3429158540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b414bdc0 0x7f86b40b46c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f86b40744c0 tx=0x7f86a402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 -- 172.21.15.5:0/3429158540 shutdown_connections 2024-04-26T22:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 --2- 172.21.15.5:0/3429158540 >> v2:172.21.15.112:3300/0 conn(0x7f86b40b3300 0x7f86b40b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 --2- 172.21.15.5:0/3429158540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b414bdc0 0x7f86b40b46c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 -- 172.21.15.5:0/3429158540 >> 172.21.15.5:0/3429158540 conn(0x7f86b406c300 msgr2=0x7f86b406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 -- 172.21.15.5:0/3429158540 shutdown_connections 2024-04-26T22:04:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.897+0000 7f86b9400640 1 -- 172.21.15.5:0/3429158540 wait complete. 2024-04-26T22:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.900+0000 7f86b9400640 1 Processor -- start 2024-04-26T22:04:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.900+0000 7f86b9400640 1 -- start start 2024-04-26T22:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b9400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86b4073590 0x7f86b4141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40b3300 0x7f86b41420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b414bdc0 0x7f86b4140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b9400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f86b40afe80 con 0x7f86b40b3300 2024-04-26T22:04:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b9400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86b406ebc0 con 0x7f86b414bdc0 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b9400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f86b40b0000 con 0x7f86b4073590 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40b3300 0x7f86b41420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40b3300 0x7f86b41420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34314/0 (socket says 172.21.15.5:34314) 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.901+0000 7f86b3400640 1 -- 172.21.15.5:0/871547377 learned_addr learned my addr 172.21.15.5:0/871547377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b3e00640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86b4073590 0x7f86b4141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b8a00640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b414bdc0 0x7f86b4140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b3400640 1 -- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86b4073590 msgr2=0x7f86b4141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b3400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86b4073590 0x7f86b4141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b3400640 1 -- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b414bdc0 msgr2=0x7f86b4140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b3400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b414bdc0 0x7f86b4140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b3400640 1 -- 172.21.15.5:0/871547377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b41440d0 con 0x7f86b40b3300 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b8a00640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b414bdc0 0x7f86b4140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86b3400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40b3300 0x7f86b41420b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f86a000d800 tx=0x7f86a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.902+0000 7f86abe00640 1 -- 172.21.15.5:0/871547377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0004020 con 0x7f86b40b3300 2024-04-26T22:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.903+0000 7f86abe00640 1 -- 172.21.15.5:0/871547377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f86a00041c0 con 0x7f86b40b3300 2024-04-26T22:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.903+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b4144370 con 0x7f86b40b3300 2024-04-26T22:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.903+0000 7f86abe00640 1 -- 172.21.15.5:0/871547377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a00043b0 con 0x7f86b40b3300 2024-04-26T22:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.903+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b41425f0 con 0x7f86b40b3300 2024-04-26T22:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.904+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b4075db0 con 0x7f86b40b3300 2024-04-26T22:04:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.905+0000 7f86abe00640 1 -- 172.21.15.5:0/871547377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86a001b020 con 0x7f86b40b3300 2024-04-26T22:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.906+0000 7f86abe00640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f869406c920 0x7f869406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.906+0000 7f86abe00640 1 -- 172.21.15.5:0/871547377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f86a008bd40 con 0x7f86b40b3300 2024-04-26T22:04:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.907+0000 7f86b3e00640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f869406c920 0x7f869406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.908+0000 7f86b3e00640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f869406c920 0x7f869406ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f86a4034000 tx=0x7f86a402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:19.910+0000 7f86abe00640 1 -- 172.21.15.5:0/871547377 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f86a0059d60 con 0x7f86b40b3300 2024-04-26T22:04:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.163+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86b40b3c10 con 0x7f86b40b3300 2024-04-26T22:04:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.165+0000 7f86abe00640 1 -- 172.21.15.5:0/871547377 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7f86a0059660 con 0x7f86b40b3300 2024-04-26T22:04:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:04:20.166 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:39.095752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T22:04:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-04-26T22:04:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f869406c920 msgr2=0x7f869406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f869406c920 0x7f869406ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f86a4034000 tx=0x7f86a402e000 comp rx=0 tx=0).stop 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40b3300 msgr2=0x7f86b41420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40b3300 0x7f86b41420b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f86a000d800 tx=0x7f86a000dcc0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 shutdown_connections 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86b414bdc0 0x7f86b4140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f869406c920 0x7f869406ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40b3300 0x7f86b41420b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 --2- 172.21.15.5:0/871547377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86b4073590 0x7f86b4141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.167+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 >> 172.21.15.5:0/871547377 conn(0x7f86b406c300 msgr2=0x7f86b40b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.168+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 shutdown_connections 2024-04-26T22:04:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.168+0000 7f86b9400640 1 -- 172.21.15.5:0/871547377 wait complete. 2024-04-26T22:04:20.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.406+0000 7efcc9e00640 1 Processor -- start 2024-04-26T22:04:20.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.406+0000 7efcc9e00640 1 -- start start 2024-04-26T22:04:20.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.408+0000 7efcc9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcc40b6d50 0x7efcc4146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.408+0000 7efcc9e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc4070d90 con 0x7efcc4073ce0 2024-04-26T22:04:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.408+0000 7efcc9e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc40b0780 con 0x7efcc41469c0 2024-04-26T22:04:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.408+0000 7efcc9e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efcc40b7130 con 0x7efcc40b6d50 2024-04-26T22:04:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.408+0000 7efcc3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efcc4073ce0 0x7efcc4150d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56974/0 (socket says 172.21.15.5:56974) 2024-04-26T22:04:20.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.408+0000 7efcc3400640 1 -- 172.21.15.5:0/2782727118 learned_addr learned my addr 172.21.15.5:0/2782727118 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.408+0000 7efcc2a00640 1 --2- 172.21.15.5:0/2782727118 >> v2:172.21.15.112:3300/0 conn(0x7efcc40b6d50 0x7efcc4146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525917448 0 0) 0x7efcc4070d90 con 0x7efcc4073ce0 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca8003520 con 0x7efcc4073ce0 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 28799210 0 0) 0x7efca8003520 con 0x7efcc4073ce0 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 >> v2:172.21.15.112:3300/0 conn(0x7efcc40b6d50 msgr2=0x7efcc4146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 --2- 172.21.15.5:0/2782727118 >> v2:172.21.15.112:3300/0 conn(0x7efcc40b6d50 0x7efcc4146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 >> v1:172.21.15.112:6789/0 conn(0x7efcc41469c0 legacy=0x7efcc40735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40b0a20 con 0x7efcc4073ce0 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7efcbc0019f0 con 0x7efcc4073ce0 2024-04-26T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 >> v1:172.21.15.5:6789/0 conn(0x7efcc4073ce0 legacy=0x7efcc4150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca8003a00 0x7efca8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.409+0000 7efcc2000640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efca8004800 0x7efca8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2000640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8005210 0x7efca800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40b7130 con 0x7efca8003a00 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efca800c160 con 0x7efca8005210 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efca800c360 con 0x7efca8004800 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2a00640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca8003a00 0x7efca8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc3400640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8005210 0x7efca800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2a00640 1 -- 172.21.15.5:0/2782727118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efca8004800 msgr2=0x7efca8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2a00640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efca8004800 0x7efca8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2a00640 1 -- 172.21.15.5:0/2782727118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8005210 msgr2=0x7efca800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2a00640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8005210 0x7efca800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc2a00640 1 -- 172.21.15.5:0/2782727118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca8003520 con 0x7efca8003a00 2024-04-26T22:04:20.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.410+0000 7efcc3400640 1 -- 172.21.15.5:0/2782727118 reap_dead start 2024-04-26T22:04:20.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.411+0000 7efcc2a00640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca8003a00 0x7efca8003e20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009a90 tx=0x7efca8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce97463920b92b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:20.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4036070 con 0x7efca8003a00 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efcb4031400 con 0x7efca8003a00 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc2000640 1 -- 172.21.15.5:0/2782727118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4009690 con 0x7efca8003a00 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc9e00640 1 -- 172.21.15.5:0/2782727118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca8003a00 msgr2=0x7efca8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca8003a00 0x7efca8003e20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009a90 tx=0x7efca8005830 comp rx=0 tx=0).stop 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc9e00640 1 -- 172.21.15.5:0/2782727118 shutdown_connections 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2782727118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efca8003a00 0x7efca8003e20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.412+0000 7efcc9e00640 1 -- 172.21.15.5:0/2782727118 >> 172.21.15.5:0/2782727118 conn(0x7efcc406c720 msgr2=0x7efcc406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.413+0000 7efcc9e00640 1 -- 172.21.15.5:0/2782727118 shutdown_connections 2024-04-26T22:04:20.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.413+0000 7efcc9e00640 1 -- 172.21.15.5:0/2782727118 wait complete. 2024-04-26T22:04:20.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.414+0000 7efcc9e00640 1 Processor -- start 2024-04-26T22:04:20.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.414+0000 7efcc9e00640 1 -- start start 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.415+0000 7efcc9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8003a00 0x7efcc4142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.415+0000 7efcc9e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcc4141520 0x7efcc40afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.415+0000 7efcc9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc41419a0 0x7efcc40aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.415+0000 7efcc9e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40b3bf0 con 0x7efcc41419a0 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.415+0000 7efcc9e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4070870 con 0x7efca8003a00 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.415+0000 7efcc9e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efcc40b4050 con 0x7efcc4141520 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc41419a0 0x7efcc40aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc41419a0 0x7efcc40aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34332/0 (socket says 172.21.15.5:34332) 2024-04-26T22:04:20.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8003a00 0x7efcc4142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 -- 172.21.15.5:0/2765978253 learned_addr learned my addr 172.21.15.5:0/2765978253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcbbe00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcc4141520 0x7efcc40afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 -- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcc4141520 msgr2=0x7efcc40afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcc4141520 0x7efcc40afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 -- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8003a00 msgr2=0x7efcc4142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8003a00 0x7efcc4142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 -- 172.21.15.5:0/2765978253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc41dbd30 con 0x7efcc41419a0 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.416+0000 7efcc3400640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc41419a0 0x7efcc40aff50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efcbc007c40 tx=0x7efcbc00b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.417+0000 7efcbb400640 1 -- 172.21.15.5:0/2765978253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00b8d0 con 0x7efcc41419a0 2024-04-26T22:04:20.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.417+0000 7efcbb400640 1 -- 172.21.15.5:0/2765978253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efcbc00ba70 con 0x7efcc41419a0 2024-04-26T22:04:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.417+0000 7efcbb400640 1 -- 172.21.15.5:0/2765978253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00be80 con 0x7efcc41419a0 2024-04-26T22:04:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.417+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc41dc010 con 0x7efcc41419a0 2024-04-26T22:04:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.417+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc4140df0 con 0x7efcc41419a0 2024-04-26T22:04:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.418+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc4075db0 con 0x7efcc41419a0 2024-04-26T22:04:20.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.419+0000 7efcbb400640 1 -- 172.21.15.5:0/2765978253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcbc01b020 con 0x7efcc41419a0 2024-04-26T22:04:20.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.420+0000 7efcbb400640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efca006c8f0 0x7efca006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.420+0000 7efcbb400640 1 -- 172.21.15.5:0/2765978253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7efcbc08c1f0 con 0x7efcc41419a0 2024-04-26T22:04:20.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.421+0000 7efcc2a00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efca006c8f0 0x7efca006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.422+0000 7efcc2a00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efca006c8f0 0x7efca006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efcb4033000 tx=0x7efcb4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:20.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.425+0000 7efcbb400640 1 -- 172.21.15.5:0/2765978253 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efcbc05a180 con 0x7efcc41419a0 2024-04-26T22:04:20.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.673+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcc40b7a60 con 0x7efcc41419a0 2024-04-26T22:04:20.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.674+0000 7efcbb400640 1 -- 172.21.15.5:0/2765978253 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7efcbc059a80 con 0x7efcc41419a0 2024-04-26T22:04:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:04:20.676 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2682872946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2682872946},{"type":"v1","addr":"172.21.15.5:6833","nonce":2682872946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:37:16.886712+0000","modified":"2024-04-26T21:37:39.095752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/1466535528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1466535528},{"type":"v1","addr":"172.21.15.112:6835","nonce":1466535528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-26T22:04:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-04-26T22:04:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efca006c8f0 msgr2=0x7efca006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efca006c8f0 0x7efca006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efcb4033000 tx=0x7efcb4008030 comp rx=0 tx=0).stop 2024-04-26T22:04:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc41419a0 msgr2=0x7efcc40aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc41419a0 0x7efcc40aff50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efcbc007c40 tx=0x7efcbc00b0d0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 shutdown_connections 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7efca006c8f0 0x7efca006edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc41419a0 0x7efcc40aff50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcc4141520 0x7efcc40afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 --2- 172.21.15.5:0/2765978253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efca8003a00 0x7efcc4142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 >> 172.21.15.5:0/2765978253 conn(0x7efcc406c720 msgr2=0x7efcc4072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 shutdown_connections 2024-04-26T22:04:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.677+0000 7efcc9e00640 1 -- 172.21.15.5:0/2765978253 wait complete. 2024-04-26T22:04:20.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:20.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.899+0000 7f4ba2400640 1 Processor -- start 2024-04-26T22:04:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.900+0000 7f4ba2400640 1 -- start start 2024-04-26T22:04:20.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4ba2400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b9c0b5fc0 0x7f4b9c073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4ba2400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c073b50 0x7f4b9c150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4ba2400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c070bc0 con 0x7f4b9c0b3360 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4ba2400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c0b43e0 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4ba2400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c071c20 con 0x7f4b9c073b50 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4ba1000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4b9c0b3360 0x7f4b9c146a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56976/0 (socket says 172.21.15.5:56976) 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4ba1000640 1 -- 172.21.15.5:0/3588419528 learned_addr learned my addr 172.21.15.5:0/3588419528 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.901+0000 7f4b9be00640 1 --2- 172.21.15.5:0/3588419528 >> v2:172.21.15.5:3300/0 conn(0x7f4b9c0b5fc0 0x7f4b9c073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.902+0000 7f4ba1a00640 1 --2- 172.21.15.5:0/3588419528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c073b50 0x7f4b9c150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.902+0000 7f4b9b400640 1 -- 172.21.15.5:0/3588419528 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 468009719 0 0) 0x7f4b9c070bc0 con 0x7f4b9c0b3360 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.902+0000 7f4b9be00640 1 -- 172.21.15.5:0/3588419528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c073b50 msgr2=0x7f4b9c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.902+0000 7f4b9be00640 1 --2- 172.21.15.5:0/3588419528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c073b50 0x7f4b9c150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.902+0000 7f4b9be00640 1 -- 172.21.15.5:0/3588419528 >> v1:172.21.15.5:6789/0 conn(0x7f4b9c0b3360 legacy=0x7f4b9c146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.902+0000 7f4b9be00640 1 -- 172.21.15.5:0/3588419528 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c0b3740 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.902+0000 7f4ba1a00640 1 --2- 172.21.15.5:0/3588419528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c073b50 0x7f4b9c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.903+0000 7f4b9be00640 1 --2- 172.21.15.5:0/3588419528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c073610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4b880097d0 tx=0x7f4b8802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9848f6455ca262 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.903+0000 7f4b9b400640 1 -- 172.21.15.5:0/3588419528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88037070 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.903+0000 7f4b9b400640 1 -- 172.21.15.5:0/3588419528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4b88032440 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.903+0000 7f4b9b400640 1 -- 172.21.15.5:0/3588419528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88032830 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 -- 172.21.15.5:0/3588419528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 msgr2=0x7f4b9c073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 --2- 172.21.15.5:0/3588419528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c073610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4b880097d0 tx=0x7f4b8802a1c0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 -- 172.21.15.5:0/3588419528 shutdown_connections 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 --2- 172.21.15.5:0/3588419528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c073b50 0x7f4b9c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 --2- 172.21.15.5:0/3588419528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c073610 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 -- 172.21.15.5:0/3588419528 >> 172.21.15.5:0/3588419528 conn(0x7f4b9c06c300 msgr2=0x7f4b9c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 -- 172.21.15.5:0/3588419528 shutdown_connections 2024-04-26T22:04:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.904+0000 7f4ba2400640 1 -- 172.21.15.5:0/3588419528 wait complete. 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.905+0000 7f4ba2400640 1 Processor -- start 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.906+0000 7f4ba2400640 1 -- start start 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.906+0000 7f4ba2400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9c073b50 0x7f4b9c142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.906+0000 7f4ba2400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c0b3360 0x7f4b9c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.906+0000 7f4ba2400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.906+0000 7f4ba2400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c146520 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.906+0000 7f4ba2400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c073f60 con 0x7f4b9c073b50 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.906+0000 7f4ba2400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c06ebc0 con 0x7f4b9c0b3360 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34364/0 (socket says 172.21.15.5:34364) 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 -- 172.21.15.5:0/625581800 learned_addr learned my addr 172.21.15.5:0/625581800 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1000640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9c073b50 0x7f4b9c142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4b9be00640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c0b3360 0x7f4b9c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 -- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c0b3360 msgr2=0x7f4b9c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c0b3360 0x7f4b9c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 -- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9c073b50 msgr2=0x7f4b9c142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:20.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9c073b50 0x7f4b9c142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:20.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1a00640 1 -- 172.21.15.5:0/625581800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c13cbc0 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.907+0000 7f4ba1000640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9c073b50 0x7f4b9c142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:20.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.908+0000 7f4ba1a00640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c136ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400cef0 tx=0x7f4b9400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:20.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.908+0000 7f4b98c00640 1 -- 172.21.15.5:0/625581800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9401a070 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.908+0000 7f4b98c00640 1 -- 172.21.15.5:0/625581800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4b9400d860 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.908+0000 7f4b98c00640 1 -- 172.21.15.5:0/625581800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400dc70 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.908+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c142020 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.908+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c0b2470 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.909+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c0b56a0 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.910+0000 7f4b98c00640 1 -- 172.21.15.5:0/625581800 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b9401d070 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.911+0000 7f4b98c00640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4b7c06c8f0 0x7f4b7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.911+0000 7f4b98c00640 1 -- 172.21.15.5:0/625581800 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4b9408c8d0 con 0x7f4b9c0b5fc0 2024-04-26T22:04:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.912+0000 7f4ba1000640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4b7c06c8f0 0x7f4b7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:20.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.913+0000 7f4ba1000640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4b7c06c8f0 0x7f4b7c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b90007fd0 tx=0x7f4b90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:20.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:20.915+0000 7f4b98c00640 1 -- 172.21.15.5:0/625581800 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b9c0b56a0 con 0x7f4b9c0b5fc0 2024-04-26T22:04:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.122+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b9c075db0 con 0x7f4b9c0b5fc0 2024-04-26T22:04:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.126+0000 7f4b98c00640 1 -- 172.21.15.5:0/625581800 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18776 (secure 0 0 0) 0x7f4b9405a920 con 0x7f4b9c0b5fc0 2024-04-26T22:04:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-26T22:04:21.127 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"fsid":"a3a415d8-7c54-4abb-9c5e-72229b6eddf5","created":"2024-04-26T21:36:52.206355+0000","modified":"2024-04-26T21:37:58.718657+0000","last_up_change":"2024-04-26T21:37:04.203744+0000","last_in_change":"2024-04-26T21:36:55.430094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:37:05.484084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:37:14.651248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:37:15.859697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:37:19.462053+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"054c9b7f-cfba-42b9-ab0c-8e001c866ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6802","nonce":2132096310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6805","nonce":2132096310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6811","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6813","nonce":2132096310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":2132096310},{"type":"v1","addr":"172.21.15.5:6809","nonce":2132096310}]},"public_addr":"172.21.15.5:6802/2132096310","cluster_addr":"172.21.15.5:6805/2132096310","heartbeat_back_addr":"172.21.15.5:6813/2132096310","heartbeat_front_addr":"172.21.15.5:6809/2132096310","state":["exists","up"]},{"osd":1,"uuid":"1ab1bb35-f570-4fcf-a8ab-b0211996a005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6804","nonce":29367179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6808","nonce":29367179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6815","nonce":29367179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":29367179},{"type":"v1","addr":"172.21.15.5:6812","nonce":29367179}]},"public_addr":"172.21.15.5:6804/29367179","cluster_addr":"172.21.15.5:6808/29367179","heartbeat_back_addr":"172.21.15.5:6815/29367179","heartbeat_front_addr":"172.21.15.5:6812/29367179","state":["exists","up"]},{"osd":2,"uuid":"cd21fc58-f743-42ab-9031-65f2a0f6f68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6817","nonce":1477821475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6819","nonce":1477821475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6825","nonce":1477821475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1477821475},{"type":"v1","addr":"172.21.15.5:6821","nonce":1477821475}]},"public_addr":"172.21.15.5:6817/1477821475","cluster_addr":"172.21.15.5:6819/1477821475","heartbeat_back_addr":"172.21.15.5:6825/1477821475","heartbeat_front_addr":"172.21.15.5:6821/1477821475","state":["exists","up"]},{"osd":3,"uuid":"c8aa45ba-3d6d-4287-9e2b-ac9d1f8aeeaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6824","nonce":3678222192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6827","nonce":3678222192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6831","nonce":3678222192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3678222192},{"type":"v1","addr":"172.21.15.5:6829","nonce":3678222192}]},"public_addr":"172.21.15.5:6824/3678222192","cluster_addr":"172.21.15.5:6827/3678222192","heartbeat_back_addr":"172.21.15.5:6831/3678222192","heartbeat_front_addr":"172.21.15.5:6829/3678222192","state":["exists","up"]},{"osd":4,"uuid":"4c0527e4-7a0c-42a2-954f-d141bcf0b003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6825","nonce":2443506001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6827","nonce":2443506001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6831","nonce":2443506001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2443506001},{"type":"v1","addr":"172.21.15.112:6829","nonce":2443506001}]},"public_addr":"172.21.15.112:6825/2443506001","cluster_addr":"172.21.15.112:6827/2443506001","heartbeat_back_addr":"172.21.15.112:6831/2443506001","heartbeat_front_addr":"172.21.15.112:6829/2443506001","state":["exists","up"]},{"osd":5,"uuid":"c023e884-9675-48b7-be60-b237c3109def","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6809","nonce":2214364032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6811","nonce":2214364032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6815","nonce":2214364032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2214364032},{"type":"v1","addr":"172.21.15.112:6813","nonce":2214364032}]},"public_addr":"172.21.15.112:6809/2214364032","cluster_addr":"172.21.15.112:6811/2214364032","heartbeat_back_addr":"172.21.15.112:6815/2214364032","heartbeat_front_addr":"172.21.15.112:6813/2214364032","state":["exists","up"]},{"osd":6,"uuid":"42de0ad9-495e-40ee-9e2f-62d902f26a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6801","nonce":3731383077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6803","nonce":3731383077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6807","nonce":3731383077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3731383077},{"type":"v1","addr":"172.21.15.112:6805","nonce":3731383077}]},"public_addr":"172.21.15.112:6801/3731383077","cluster_addr":"172.21.15.112:6803/3731383077","heartbeat_back_addr":"172.21.15.112:6807/3731383077","heartbeat_front_addr":"172.21.15.112:6805/3731383077","state":["exists","up"]},{"osd":7,"uuid":"c9b868df-2448-4c2f-ba2b-5551b265114c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6817","nonce":403622825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6819","nonce":403622825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6823","nonce":403622825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":403622825},{"type":"v1","addr":"172.21.15.112:6821","nonce":403622825}]},"public_addr":"172.21.15.112:6817/403622825","cluster_addr":"172.21.15.112:6819/403622825","heartbeat_back_addr":"172.21.15.112:6823/403622825","heartbeat_front_addr":"172.21.15.112:6821/403622825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:01.004956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.881958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.817911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.841638+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.890996+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.665080+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.822338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:37:00.829343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4b7c06c8f0 msgr2=0x7f4b7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4b7c06c8f0 0x7f4b7c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b90007fd0 tx=0x7f4b90009040 comp rx=0 tx=0).stop 2024-04-26T22:04:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 msgr2=0x7f4b9c136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c136ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400cef0 tx=0x7f4b9400a710 comp rx=0 tx=0).stop 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 shutdown_connections 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4b7c06c8f0 0x7f4b7c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b9c0b5fc0 0x7f4b9c136ad0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b9c0b3360 0x7f4b9c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 --2- 172.21.15.5:0/625581800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9c073b50 0x7f4b9c142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.128+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 >> 172.21.15.5:0/625581800 conn(0x7f4b9c06c300 msgr2=0x7f4b9c0b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.129+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 shutdown_connections 2024-04-26T22:04:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.129+0000 7f4ba2400640 1 -- 172.21.15.5:0/625581800 wait complete. 2024-04-26T22:04:21.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:04:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.362+0000 7f5e0d800640 1 Processor -- start 2024-04-26T22:04:21.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.363+0000 7f5e0d800640 1 -- start start 2024-04-26T22:04:21.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e0d800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e080b2180 0x7f5e080b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e0d800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e0814c8b0 0x7f5e0814d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e0d800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5e0814d570 0x7f5e0814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e0d800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5e080b0920 con 0x7f5e080b2180 2024-04-26T22:04:21.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e0d800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5e080b1520 con 0x7f5e0814d570 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e0d800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5e080b31d0 con 0x7f5e0814c8b0 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e07e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e080b2180 0x7f5e080b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e07e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e080b2180 0x7f5e080b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34368/0 (socket says 172.21.15.5:34368) 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.364+0000 7f5e07e00640 1 -- 172.21.15.5:0/2963397129 learned_addr learned my addr 172.21.15.5:0/2963397129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.365+0000 7f5e0ce00640 1 --2- 172.21.15.5:0/2963397129 >> v2:172.21.15.112:3300/0 conn(0x7f5e0814d570 0x7f5e0814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.365+0000 7f5e07400640 1 --2- 172.21.15.5:0/2963397129 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e0814c8b0 0x7f5e0814d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.365+0000 7f5e07e00640 1 -- 172.21.15.5:0/2963397129 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e0814c8b0 msgr2=0x7f5e0814d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.365+0000 7f5e07e00640 1 --2- 172.21.15.5:0/2963397129 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e0814c8b0 0x7f5e0814d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.365+0000 7f5e07e00640 1 -- 172.21.15.5:0/2963397129 >> v2:172.21.15.112:3300/0 conn(0x7f5e0814d570 msgr2=0x7f5e0814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.365+0000 7f5e07e00640 1 --2- 172.21.15.5:0/2963397129 >> v2:172.21.15.112:3300/0 conn(0x7f5e0814d570 0x7f5e0814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.365+0000 7f5e07e00640 1 -- 172.21.15.5:0/2963397129 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080b2560 con 0x7f5e080b2180 2024-04-26T22:04:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.366+0000 7f5e07e00640 1 --2- 172.21.15.5:0/2963397129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e080b2180 0x7f5e080b0fe0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5e080744a0 tx=0x7f5df802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68b9d30f5ceefb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.366+0000 7f5e06a00640 1 -- 172.21.15.5:0/2963397129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8037070 con 0x7f5e080b2180 2024-04-26T22:04:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.366+0000 7f5e06a00640 1 -- 172.21.15.5:0/2963397129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5df8032440 con 0x7f5e080b2180 2024-04-26T22:04:21.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.366+0000 7f5e06a00640 1 -- 172.21.15.5:0/2963397129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8032830 con 0x7f5e080b2180 2024-04-26T22:04:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 -- 172.21.15.5:0/2963397129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e080b2180 msgr2=0x7f5e080b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 --2- 172.21.15.5:0/2963397129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e080b2180 0x7f5e080b0fe0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5e080744a0 tx=0x7f5df802a140 comp rx=0 tx=0).stop 2024-04-26T22:04:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 -- 172.21.15.5:0/2963397129 shutdown_connections 2024-04-26T22:04:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 --2- 172.21.15.5:0/2963397129 >> v2:172.21.15.112:3300/0 conn(0x7f5e0814d570 0x7f5e0814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 --2- 172.21.15.5:0/2963397129 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e0814c8b0 0x7f5e0814d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 --2- 172.21.15.5:0/2963397129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e080b2180 0x7f5e080b0fe0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 -- 172.21.15.5:0/2963397129 >> 172.21.15.5:0/2963397129 conn(0x7f5e0806c300 msgr2=0x7f5e0806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 -- 172.21.15.5:0/2963397129 shutdown_connections 2024-04-26T22:04:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.367+0000 7f5e0d800640 1 -- 172.21.15.5:0/2963397129 wait complete. 2024-04-26T22:04:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.369+0000 7f5e0d800640 1 Processor -- start 2024-04-26T22:04:21.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.369+0000 7f5e0d800640 1 -- start start 2024-04-26T22:04:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0d800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e080b2180 0x7f5e0814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e0814c8b0 0x7f5e081e2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e0814d570 0x7f5e081e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0d800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0806ebc0 con 0x7f5e0814d570 2024-04-26T22:04:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0d800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e080b0b50 con 0x7f5e0814c8b0 2024-04-26T22:04:21.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0d800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5e080b16f0 con 0x7f5e080b2180 2024-04-26T22:04:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e0814d570 0x7f5e081e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e0814d570 0x7f5e081e55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34380/0 (socket says 172.21.15.5:34380) 2024-04-26T22:04:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e0ce00640 1 -- 172.21.15.5:0/821665004 learned_addr learned my addr 172.21.15.5:0/821665004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e07400640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e0814c8b0 0x7f5e081e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.370+0000 7f5e07e00640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e080b2180 0x7f5e0814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0ce00640 1 -- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e080b2180 msgr2=0x7f5e0814fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0ce00640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e080b2180 0x7f5e0814fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0ce00640 1 -- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e0814c8b0 msgr2=0x7f5e081e2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0ce00640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e0814c8b0 0x7f5e081e2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0ce00640 1 -- 172.21.15.5:0/821665004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e08070860 con 0x7f5e0814d570 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0ce00640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e0814d570 0x7f5e081e55a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e00007d80 tx=0x7f5e0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5dffe00640 1 -- 172.21.15.5:0/821665004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00014420 con 0x7f5e0814d570 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5dffe00640 1 -- 172.21.15.5:0/821665004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e00019070 con 0x7f5e0814d570 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5dffe00640 1 -- 172.21.15.5:0/821665004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00014820 con 0x7f5e0814d570 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e080719e0 con 0x7f5e0814d570 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.371+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e08071700 con 0x7f5e0814d570 2024-04-26T22:04:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.373+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e08075db0 con 0x7f5e0814d570 2024-04-26T22:04:21.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.374+0000 7f5dffe00640 1 -- 172.21.15.5:0/821665004 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e000149c0 con 0x7f5e0814d570 2024-04-26T22:04:21.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.375+0000 7f5dffe00640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5de806c8f0 0x7f5de806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.375+0000 7f5dffe00640 1 -- 172.21.15.5:0/821665004 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5e0008c7e0 con 0x7f5e0814d570 2024-04-26T22:04:21.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.375+0000 7f5e07e00640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5de806c8f0 0x7f5de806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.376+0000 7f5e07e00640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5de806c8f0 0x7f5de806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5df8034000 tx=0x7f5df802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.379+0000 7f5dffe00640 1 -- 172.21.15.5:0/821665004 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5e00011260 con 0x7f5e0814d570 2024-04-26T22:04:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.630+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5e0814c320 con 0x7f5e0814d570 2024-04-26T22:04:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.635+0000 7f5dffe00640 1 -- 172.21.15.5:0/821665004 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f5e0005a810 con 0x7f5e0814d570 2024-04-26T22:04:21.636 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:04:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5de806c8f0 msgr2=0x7f5de806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5de806c8f0 0x7f5de806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5df8034000 tx=0x7f5df802e000 comp rx=0 tx=0).stop 2024-04-26T22:04:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e0814d570 msgr2=0x7f5e081e55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e0814d570 0x7f5e081e55a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e00007d80 tx=0x7f5e0000e4b0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 shutdown_connections 2024-04-26T22:04:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f5de806c8f0 0x7f5de806edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e0814d570 0x7f5e081e55a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e0814c8b0 0x7f5e081e2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 --2- 172.21.15.5:0/821665004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5e080b2180 0x7f5e0814fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.638+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 >> 172.21.15.5:0/821665004 conn(0x7f5e0806c300 msgr2=0x7f5e0814b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.639+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 shutdown_connections 2024-04-26T22:04:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.639+0000 7f5e0d800640 1 -- 172.21.15.5:0/821665004 wait complete. 2024-04-26T22:04:21.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:04:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.857+0000 7f4d97800640 1 Processor -- start 2024-04-26T22:04:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.857+0000 7f4d97800640 1 -- start start 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d97800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d901401f0 0x7f4d90140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d97800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d9014ed70 0x7f4d90151160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d97800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d900b3bb0 con 0x7f4d9006e780 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d97800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9006eb60 con 0x7f4d9014ed70 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d97800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4d900b3440 con 0x7f4d901401f0 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d95800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d9014ed70 0x7f4d90151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d95800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d9014ed70 0x7f4d90151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34384/0 (socket says 172.21.15.5:34384) 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d95800640 1 -- 172.21.15.5:0/3441639769 learned_addr learned my addr 172.21.15.5:0/3441639769 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.859+0000 7f4d8fe00640 1 --2- 172.21.15.5:0/3441639769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d901401f0 0x7f4d90140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.860+0000 7f4d95800640 1 -- 172.21.15.5:0/3441639769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d901401f0 msgr2=0x7f4d90140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.860+0000 7f4d95800640 1 --2- 172.21.15.5:0/3441639769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d901401f0 0x7f4d90140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.860+0000 7f4d95800640 1 -- 172.21.15.5:0/3441639769 >> v1:172.21.15.112:6789/0 conn(0x7f4d9006e780 legacy=0x7f4d900b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.860+0000 7f4d95800640 1 -- 172.21.15.5:0/3441639769 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d900b11b0 con 0x7f4d9014ed70 2024-04-26T22:04:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.861+0000 7f4d95800640 1 --2- 172.21.15.5:0/3441639769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d90151160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009e50 tx=0x7f4d8802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4632444e0641d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.861+0000 7f4d8f400640 1 -- 172.21.15.5:0/3441639769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88036070 con 0x7f4d9014ed70 2024-04-26T22:04:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.861+0000 7f4d8f400640 1 -- 172.21.15.5:0/3441639769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4d88031600 con 0x7f4d9014ed70 2024-04-26T22:04:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.861+0000 7f4d8f400640 1 -- 172.21.15.5:0/3441639769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d880319f0 con 0x7f4d9014ed70 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 -- 172.21.15.5:0/3441639769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 msgr2=0x7f4d90151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 --2- 172.21.15.5:0/3441639769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d90151160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009e50 tx=0x7f4d8802a680 comp rx=0 tx=0).stop 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 -- 172.21.15.5:0/3441639769 shutdown_connections 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 --2- 172.21.15.5:0/3441639769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d90151160 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 --2- 172.21.15.5:0/3441639769 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d901401f0 0x7f4d90140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 -- 172.21.15.5:0/3441639769 >> 172.21.15.5:0/3441639769 conn(0x7f4d900b7bb0 msgr2=0x7f4d900b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 -- 172.21.15.5:0/3441639769 shutdown_connections 2024-04-26T22:04:21.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.862+0000 7f4d97800640 1 -- 172.21.15.5:0/3441639769 wait complete. 2024-04-26T22:04:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.864+0000 7f4d97800640 1 Processor -- start 2024-04-26T22:04:21.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.864+0000 7f4d97800640 1 -- start start 2024-04-26T22:04:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d97800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d9006e780 0x7f4d9013d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d97800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d901401f0 0x7f4d9013e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d97800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d901df370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d97800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4d900b30c0 con 0x7f4d9014ed70 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d97800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d90140b90 con 0x7f4d901401f0 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d97800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4d900b4090 con 0x7f4d9006e780 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d95800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d901df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d95800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d901df370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34400/0 (socket says 172.21.15.5:34400) 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d95800640 1 -- 172.21.15.5:0/2674148588 learned_addr learned my addr 172.21.15.5:0/2674148588 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d8fe00640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d901401f0 0x7f4d9013e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.865+0000 7f4d94e00640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d9006e780 0x7f4d9013d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d95800640 1 -- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d9006e780 msgr2=0x7f4d9013d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d95800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d9006e780 0x7f4d9013d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d95800640 1 -- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d901401f0 msgr2=0x7f4d9013e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d95800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d901401f0 0x7f4d9013e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d95800640 1 -- 172.21.15.5:0/2674148588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9013df40 con 0x7f4d9014ed70 2024-04-26T22:04:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d95800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d901df370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009f70 tx=0x7f4d88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d8cc00640 1 -- 172.21.15.5:0/2674148588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88041020 con 0x7f4d9014ed70 2024-04-26T22:04:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d8cc00640 1 -- 172.21.15.5:0/2674148588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4d88008690 con 0x7f4d9014ed70 2024-04-26T22:04:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d8cc00640 1 -- 172.21.15.5:0/2674148588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88036040 con 0x7f4d9014ed70 2024-04-26T22:04:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d90139550 con 0x7f4d9014ed70 2024-04-26T22:04:21.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.866+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9013ec50 con 0x7f4d9014ed70 2024-04-26T22:04:21.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.868+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9013ef10 con 0x7f4d9014ed70 2024-04-26T22:04:21.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.869+0000 7f4d8cc00640 1 -- 172.21.15.5:0/2674148588 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d88044020 con 0x7f4d9014ed70 2024-04-26T22:04:21.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.870+0000 7f4d8cc00640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4d7006c940 0x7f4d7006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.870+0000 7f4d8cc00640 1 -- 172.21.15.5:0/2674148588 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f4d880ace10 con 0x7f4d9014ed70 2024-04-26T22:04:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.871+0000 7f4d94e00640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4d7006c940 0x7f4d7006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.871+0000 7f4d94e00640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4d7006c940 0x7f4d7006ee00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000f60 tx=0x7f4d84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:21.875+0000 7f4d8cc00640 1 -- 172.21.15.5:0/2674148588 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d9013ef10 con 0x7f4d9014ed70 2024-04-26T22:04:21.876 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-04-26T22:04:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.132+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4d90075db0 con 0x7f4d9014ed70 2024-04-26T22:04:22.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.690+0000 7f4d8cc00640 1 -- 172.21.15.5:0/2674148588 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f4d880b0030 con 0x7f4d9014ed70 2024-04-26T22:04:22.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.693+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4d7006c940 msgr2=0x7f4d7006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.693+0000 7f4d97800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4d7006c940 0x7f4d7006ee00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000f60 tx=0x7f4d84009040 comp rx=0 tx=0).stop 2024-04-26T22:04:22.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.693+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 msgr2=0x7f4d901df370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.693+0000 7f4d97800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d901df370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009f70 tx=0x7f4d88004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.693+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 shutdown_connections 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.694+0000 7f4d97800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f4d7006c940 0x7f4d7006ee00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.694+0000 7f4d97800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d9014ed70 0x7f4d901df370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.694+0000 7f4d97800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d901401f0 0x7f4d9013e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.694+0000 7f4d97800640 1 --2- 172.21.15.5:0/2674148588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d9006e780 0x7f4d9013d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.694+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 >> 172.21.15.5:0/2674148588 conn(0x7f4d900b7bb0 msgr2=0x7f4d90137d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.694+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 shutdown_connections 2024-04-26T22:04:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.694+0000 7f4d97800640 1 -- 172.21.15.5:0/2674148588 wait complete. 2024-04-26T22:04:22.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:04:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.933+0000 7f9c8b200640 1 Processor -- start 2024-04-26T22:04:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.934+0000 7f9c8b200640 1 -- start start 2024-04-26T22:04:22.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c8b200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c840be640 0x7f9c840b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c8b200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c840b4250 0x7f9c840b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c8b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c840b7b80 con 0x7f9c84142220 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c8b200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9c840bea20 con 0x7f9c840be640 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c8b200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9c840b6680 con 0x7f9c840b4250 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c89e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c840be640 0x7f9c840b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c89e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c840be640 0x7f9c840b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34404/0 (socket says 172.21.15.5:34404) 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c89e00640 1 -- 172.21.15.5:0/2487094282 learned_addr learned my addr 172.21.15.5:0/2487094282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.935+0000 7f9c89400640 1 --2- 172.21.15.5:0/2487094282 >> v2:172.21.15.112:3300/0 conn(0x7f9c840b4250 0x7f9c840b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.936+0000 7f9c89e00640 1 -- 172.21.15.5:0/2487094282 >> v2:172.21.15.112:3300/0 conn(0x7f9c840b4250 msgr2=0x7f9c840b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.936+0000 7f9c89e00640 1 --2- 172.21.15.5:0/2487094282 >> v2:172.21.15.112:3300/0 conn(0x7f9c840b4250 0x7f9c840b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.936+0000 7f9c89e00640 1 -- 172.21.15.5:0/2487094282 >> v1:172.21.15.5:6789/0 conn(0x7f9c84142220 legacy=0x7f9c841426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.936+0000 7f9c89e00640 1 -- 172.21.15.5:0/2487094282 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c840b6960 con 0x7f9c840be640 2024-04-26T22:04:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.936+0000 7f9c88a00640 1 -- 172.21.15.5:0/2487094282 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099404085 0 0) 0x7f9c840b7b80 con 0x7f9c84142220 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.937+0000 7f9c89e00640 1 --2- 172.21.15.5:0/2487094282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c840b5760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9c840ba180 tx=0x7f9c7802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa3d19d999ee431 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.937+0000 7f9c88a00640 1 -- 172.21.15.5:0/2487094282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c78036070 con 0x7f9c840be640 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.937+0000 7f9c88a00640 1 -- 172.21.15.5:0/2487094282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c78031600 con 0x7f9c840be640 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.937+0000 7f9c88a00640 1 -- 172.21.15.5:0/2487094282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780319f0 con 0x7f9c840be640 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 -- 172.21.15.5:0/2487094282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 msgr2=0x7f9c840b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 --2- 172.21.15.5:0/2487094282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c840b5760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9c840ba180 tx=0x7f9c7802a6a0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 -- 172.21.15.5:0/2487094282 shutdown_connections 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 --2- 172.21.15.5:0/2487094282 >> v2:172.21.15.112:3300/0 conn(0x7f9c840b4250 0x7f9c840b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 --2- 172.21.15.5:0/2487094282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c840b5760 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 -- 172.21.15.5:0/2487094282 >> 172.21.15.5:0/2487094282 conn(0x7f9c840686c0 msgr2=0x7f9c840bdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 -- 172.21.15.5:0/2487094282 shutdown_connections 2024-04-26T22:04:22.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.938+0000 7f9c8b200640 1 -- 172.21.15.5:0/2487094282 wait complete. 2024-04-26T22:04:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.940+0000 7f9c8b200640 1 Processor -- start 2024-04-26T22:04:22.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.940+0000 7f9c8b200640 1 -- start start 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.940+0000 7f9c8b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c840b4250 0x7f9c841e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.940+0000 7f9c8b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c841cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c8b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c84142220 0x7f9c841ddda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c8b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c840ba430 con 0x7f9c840be640 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c8b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c840b4cf0 con 0x7f9c84142220 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c8b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9c841de2e0 con 0x7f9c840b4250 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c841cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c841cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34412/0 (socket says 172.21.15.5:34412) 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 -- 172.21.15.5:0/1554738663 learned_addr learned my addr 172.21.15.5:0/1554738663 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89e00640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c840b4250 0x7f9c841e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 -- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c840b4250 msgr2=0x7f9c841e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c840b4250 0x7f9c841e1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 -- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c84142220 msgr2=0x7f9c841ddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c84142220 0x7f9c841ddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.941+0000 7f9c89400640 1 -- 172.21.15.5:0/1554738663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c841d04d0 con 0x7f9c840be640 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.942+0000 7f9c89400640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c841cee50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400d800 tx=0x7f9c7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.942+0000 7f9c7e000640 1 -- 172.21.15.5:0/1554738663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74004030 con 0x7f9c840be640 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.942+0000 7f9c7e000640 1 -- 172.21.15.5:0/1554738663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c740041d0 con 0x7f9c840be640 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.942+0000 7f9c7e000640 1 -- 172.21.15.5:0/1554738663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400b6c0 con 0x7f9c840be640 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.942+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c841e13b0 con 0x7f9c840be640 2024-04-26T22:04:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.942+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c841496d0 con 0x7f9c840be640 2024-04-26T22:04:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.943+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c84075db0 con 0x7f9c840be640 2024-04-26T22:04:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.944+0000 7f9c7e000640 1 -- 172.21.15.5:0/1554738663 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c7400b860 con 0x7f9c840be640 2024-04-26T22:04:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.945+0000 7f9c7e000640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f9c6806c8f0 0x7f9c6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.945+0000 7f9c7e000640 1 -- 172.21.15.5:0/1554738663 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f9c7408c2f0 con 0x7f9c840be640 2024-04-26T22:04:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.946+0000 7f9c89e00640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f9c6806c8f0 0x7f9c6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.947+0000 7f9c89e00640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f9c6806c8f0 0x7f9c6806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c78033000 tx=0x7f9c78009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:22.950+0000 7f9c7e000640 1 -- 172.21.15.5:0/1554738663 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9c7401c360 con 0x7f9c840be640 2024-04-26T22:04:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.159+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c840695e0 con 0x7f9c840be640 2024-04-26T22:04:23.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.712+0000 7f9c7e000640 1 -- 172.21.15.5:0/1554738663 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f9c7405a2b0 con 0x7f9c840be640 2024-04-26T22:04:23.713 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.715+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f9c6806c8f0 msgr2=0x7f9c6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f9c6806c8f0 0x7f9c6806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c78033000 tx=0x7f9c78009000 comp rx=0 tx=0).stop 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 msgr2=0x7f9c841cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c841cee50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400d800 tx=0x7f9c7400dcc0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 shutdown_connections 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c84142220 0x7f9c841ddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7f9c6806c8f0 0x7f9c6806edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c840be640 0x7f9c841cee50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 --2- 172.21.15.5:0/1554738663 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9c840b4250 0x7f9c841e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 >> 172.21.15.5:0/1554738663 conn(0x7f9c840686c0 msgr2=0x7f9c84147e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 shutdown_connections 2024-04-26T22:04:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.716+0000 7f9c8b200640 1 -- 172.21.15.5:0/1554738663 wait complete. 2024-04-26T22:04:23.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:04:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.983+0000 7fe8c9200640 1 Processor -- start 2024-04-26T22:04:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.983+0000 7fe8c9200640 1 -- start start 2024-04-26T22:04:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8c40be740 0x7fe8c414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe8c41428e0 0x7fe8c414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c9200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c40b7f10 con 0x7fe8c40b6c60 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c9200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c40b5e90 con 0x7fe8c40be740 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c9200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c40beb20 con 0x7fe8c41428e0 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8c40be740 0x7fe8c414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c2a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe8c40b6c60 0x7fe8c41421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57008/0 (socket says 172.21.15.5:57008) 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c2a00640 1 -- 172.21.15.5:0/730830657 learned_addr learned my addr 172.21.15.5:0/730830657 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.984+0000 7fe8c3e00640 1 --2- 172.21.15.5:0/730830657 >> v2:172.21.15.112:3300/0 conn(0x7fe8c41428e0 0x7fe8c414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.985+0000 7fe8c2000640 1 -- 172.21.15.5:0/730830657 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987834488 0 0) 0x7fe8c40b7f10 con 0x7fe8c40b6c60 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.985+0000 7fe8c2000640 1 -- 172.21.15.5:0/730830657 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8a8003520 con 0x7fe8c40b6c60 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.985+0000 7fe8c3400640 1 -- 172.21.15.5:0/730830657 >> v2:172.21.15.112:3300/0 conn(0x7fe8c41428e0 msgr2=0x7fe8c414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.985+0000 7fe8c3400640 1 --2- 172.21.15.5:0/730830657 >> v2:172.21.15.112:3300/0 conn(0x7fe8c41428e0 0x7fe8c414c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.985+0000 7fe8c3400640 1 -- 172.21.15.5:0/730830657 >> v1:172.21.15.5:6789/0 conn(0x7fe8c40b6c60 legacy=0x7fe8c41421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.985+0000 7fe8c3400640 1 -- 172.21.15.5:0/730830657 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c40b5840 con 0x7fe8c40be740 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.986+0000 7fe8c3400640 1 --2- 172.21.15.5:0/730830657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c414bb60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4069050 tx=0x7fe8b402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a32123a71d148e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.986+0000 7fe8c2000640 1 -- 172.21.15.5:0/730830657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4037070 con 0x7fe8c40be740 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.986+0000 7fe8c2000640 1 -- 172.21.15.5:0/730830657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe8b402add0 con 0x7fe8c40be740 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.986+0000 7fe8c2000640 1 -- 172.21.15.5:0/730830657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4032680 con 0x7fe8c40be740 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 -- 172.21.15.5:0/730830657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 msgr2=0x7fe8c414bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 --2- 172.21.15.5:0/730830657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c414bb60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4069050 tx=0x7fe8b402a080 comp rx=0 tx=0).stop 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 -- 172.21.15.5:0/730830657 shutdown_connections 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 --2- 172.21.15.5:0/730830657 >> v2:172.21.15.112:3300/0 conn(0x7fe8c41428e0 0x7fe8c414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 --2- 172.21.15.5:0/730830657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c414bb60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 -- 172.21.15.5:0/730830657 >> 172.21.15.5:0/730830657 conn(0x7fe8c40686c0 msgr2=0x7fe8c40bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 -- 172.21.15.5:0/730830657 shutdown_connections 2024-04-26T22:04:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.987+0000 7fe8c9200640 1 -- 172.21.15.5:0/730830657 wait complete. 2024-04-26T22:04:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.989+0000 7fe8c9200640 1 Processor -- start 2024-04-26T22:04:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.989+0000 7fe8c9200640 1 -- start start 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.989+0000 7fe8c9200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8c40b6c60 0x7fe8c40bd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.989+0000 7fe8c9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c41e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c41428e0 0x7fe8c413ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c9200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c40b55e0 con 0x7fe8c40be740 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c9200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c40b5460 con 0x7fe8c41428e0 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c9200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c40ba480 con 0x7fe8c40b6c60 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c41e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c41e0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34426/0 (socket says 172.21.15.5:34426) 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 -- 172.21.15.5:0/637561047 learned_addr learned my addr 172.21.15.5:0/637561047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c3e00640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c41428e0 0x7fe8c413ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c3400640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8c40b6c60 0x7fe8c40bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 -- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8c40b6c60 msgr2=0x7fe8c40bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8c40b6c60 0x7fe8c40bd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 -- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c41428e0 msgr2=0x7fe8c413ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c41428e0 0x7fe8c413ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c2a00640 1 -- 172.21.15.5:0/637561047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c4145c00 con 0x7fe8c40be740 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.990+0000 7fe8c3e00640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c41428e0 0x7fe8c413ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.991+0000 7fe8c2a00640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c41e0c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c430 tx=0x7fe8b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.991+0000 7fe8bb400640 1 -- 172.21.15.5:0/637561047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0017070 con 0x7fe8c40be740 2024-04-26T22:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.991+0000 7fe8bb400640 1 -- 172.21.15.5:0/637561047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe8b0005ce0 con 0x7fe8c40be740 2024-04-26T22:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.991+0000 7fe8bb400640 1 -- 172.21.15.5:0/637561047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0007310 con 0x7fe8c40be740 2024-04-26T22:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.991+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c40abef0 con 0x7fe8c40be740 2024-04-26T22:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.991+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c4144ce0 con 0x7fe8c40be740 2024-04-26T22:04:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.992+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c4075db0 con 0x7fe8c40be740 2024-04-26T22:04:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.993+0000 7fe8bb400640 1 -- 172.21.15.5:0/637561047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8b001a070 con 0x7fe8c40be740 2024-04-26T22:04:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.994+0000 7fe8bb400640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe8a406c8f0 0x7fe8a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.994+0000 7fe8bb400640 1 -- 172.21.15.5:0/637561047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6383+0+0 (secure 0 0 0) 0x7fe8b008b1c0 con 0x7fe8c40be740 2024-04-26T22:04:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.995+0000 7fe8c3400640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe8a406c8f0 0x7fe8a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.996+0000 7fe8c3400640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe8a406c8f0 0x7fe8a406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4034000 tx=0x7fe8b402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:23.999+0000 7fe8bb400640 1 -- 172.21.15.5:0/637561047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe8b0058d90 con 0x7fe8c40be740 2024-04-26T22:04:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.204+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8c4145450 con 0x7fe8c40be740 2024-04-26T22:04:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.723+0000 7fe8bb400640 1 -- 172.21.15.5:0/637561047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7fe8b005d090 con 0x7fe8c40be740 2024-04-26T22:04:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-26T22:04:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.727+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe8a406c8f0 msgr2=0x7fe8a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.727+0000 7fe8c9200640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe8a406c8f0 0x7fe8a406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4034000 tx=0x7fe8b402e000 comp rx=0 tx=0).stop 2024-04-26T22:04:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.727+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 msgr2=0x7fe8c41e0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c41e0c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c430 tx=0x7fe8b000c8f0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 shutdown_connections 2024-04-26T22:04:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c41428e0 0x7fe8c413ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fe8a406c8f0 0x7fe8a406edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c40be740 0x7fe8c41e0c30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 --2- 172.21.15.5:0/637561047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe8c40b6c60 0x7fe8c40bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 >> 172.21.15.5:0/637561047 conn(0x7fe8c40686c0 msgr2=0x7fe8c40baf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 shutdown_connections 2024-04-26T22:04:24.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.728+0000 7fe8c9200640 1 -- 172.21.15.5:0/637561047 wait complete. 2024-04-26T22:04:24.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T22:04:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.950+0000 7fc64be00640 1 Processor -- start 2024-04-26T22:04:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.950+0000 7fc64be00640 1 -- start start 2024-04-26T22:04:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.951+0000 7fc64be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 0x7fc64c142220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.951+0000 7fc64be00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64c0b7b80 con 0x7fc64c0b4250 2024-04-26T22:04:24.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.951+0000 7fc64be00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64c0bea20 con 0x7fc64c0be640 2024-04-26T22:04:24.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.951+0000 7fc64be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c0b6680 con 0x7fc64c0b5e70 2024-04-26T22:04:24.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.952+0000 7fc64b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc64c0b4250 0x7fc64c142760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56874/0 (socket says 172.21.15.5:56874) 2024-04-26T22:04:24.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.952+0000 7fc64b400640 1 -- 172.21.15.5:0/2046156125 learned_addr learned my addr 172.21.15.5:0/2046156125 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-04-26T22:04:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.952+0000 7fc64a000640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 0x7fc64c142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.952+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891970504 0 0) 0x7fc64c0b7b80 con 0x7fc64c0b4250 2024-04-26T22:04:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.952+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc630003520 con 0x7fc64c0b4250 2024-04-26T22:04:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1100691078 0 0) 0x7fc630003520 con 0x7fc64c0b4250 2024-04-26T22:04:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 msgr2=0x7fc64c142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 0x7fc64c142220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 >> v1:172.21.15.112:6789/0 conn(0x7fc64c0be640 legacy=0x7fc64c0b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c0b6960 con 0x7fc64c0b4250 2024-04-26T22:04:24.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2248370655 0 0) 0x7fc6440019f0 con 0x7fc64c0b4250 2024-04-26T22:04:24.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 >> v1:172.21.15.5:6789/0 conn(0x7fc64c0b4250 legacy=0x7fc64c142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 0x7fc6300039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc630003fd0 0x7fc630004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630004d40 0x7fc6300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c0b6680 con 0x7fc630003fd0 2024-04-26T22:04:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc63000bb80 con 0x7fc630004d40 2024-04-26T22:04:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc63000bd80 con 0x7fc64c0b5e70 2024-04-26T22:04:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.953+0000 7fc64a000640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc630003fd0 0x7fc630004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.954+0000 7fc64aa00640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 0x7fc6300039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.954+0000 7fc64b400640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630004d40 0x7fc6300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.954+0000 7fc64a000640 1 -- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 msgr2=0x7fc6300039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.954+0000 7fc64a000640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c0b5e70 0x7fc6300039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.954+0000 7fc64a000640 1 -- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630004d40 msgr2=0x7fc6300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.954+0000 7fc64a000640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630004d40 0x7fc6300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.954+0000 7fc64a000640 1 -- 172.21.15.5:0/2046156125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc630003520 con 0x7fc630003fd0 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.955+0000 7fc64a000640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc630003fd0 0x7fc630004800 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc63800ba30 tx=0x7fc630005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48498a0806e54f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.955+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638030070 con 0x7fc630003fd0 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.955+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc63802ade0 con 0x7fc630003fd0 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.955+0000 7fc649600640 1 -- 172.21.15.5:0/2046156125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63800b600 con 0x7fc630003fd0 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.956+0000 7fc64be00640 1 -- 172.21.15.5:0/2046156125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc630003fd0 msgr2=0x7fc630004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.956+0000 7fc64be00640 1 --2- 172.21.15.5:0/2046156125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc630003fd0 0x7fc630004800 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc63800ba30 tx=0x7fc630005830 comp rx=0 tx=0).stop 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.956+0000 7fc64b400640 1 -- 172.21.15.5:0/2046156125 reap_dead start 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.956+0000 7fc64be00640 1 -- 172.21.15.5:0/2046156125 shutdown_connections 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.956+0000 7fc64be00640 1 -- 172.21.15.5:0/2046156125 >> 172.21.15.5:0/2046156125 conn(0x7fc64c0686c0 msgr2=0x7fc64c0bdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.956+0000 7fc64be00640 1 -- 172.21.15.5:0/2046156125 shutdown_connections 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.956+0000 7fc64be00640 1 -- 172.21.15.5:0/2046156125 wait complete. 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.958+0000 7fc64be00640 1 Processor -- start 2024-04-26T22:04:24.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.958+0000 7fc64be00640 1 -- start start 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630003fd0 0x7fc64c0bcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc64c144e80 0x7fc64c1ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c1ce930 0x7fc64c1cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c0ba430 con 0x7fc64c144e80 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c0b4cf0 con 0x7fc630003fd0 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c0bd7f0 con 0x7fc64c1ce930 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc64c144e80 0x7fc64c1ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc64c144e80 0x7fc64c1ddc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59728/0 (socket says 172.21.15.5:59728) 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 -- 172.21.15.5:0/3250197556 learned_addr learned my addr 172.21.15.5:0/3250197556 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64aa00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630003fd0 0x7fc64c0bcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64b400640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c1ce930 0x7fc64c1cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 -- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c1ce930 msgr2=0x7fc64c1cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c1ce930 0x7fc64c1cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 -- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630003fd0 msgr2=0x7fc64c0bcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630003fd0 0x7fc64c0bcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64a000640 1 -- 172.21.15.5:0/3250197556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c1cf3d0 con 0x7fc64c144e80 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.959+0000 7fc64b400640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c1ce930 0x7fc64c1cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.960+0000 7fc64a000640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc64c144e80 0x7fc64c1ddc70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc63802a8d0 tx=0x7fc6380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.960+0000 7fc642a00640 1 -- 172.21.15.5:0/3250197556 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638043030 con 0x7fc64c144e80 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.960+0000 7fc642a00640 1 -- 172.21.15.5:0/3250197556 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc63802abe0 con 0x7fc64c144e80 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.960+0000 7fc642a00640 1 -- 172.21.15.5:0/3250197556 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63800b600 con 0x7fc64c144e80 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.960+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c1443a0 con 0x7fc64c144e80 2024-04-26T22:04:24.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.960+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c1de1b0 con 0x7fc64c144e80 2024-04-26T22:04:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.961+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64c0b6f90 con 0x7fc64c144e80 2024-04-26T22:04:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.962+0000 7fc642a00640 1 -- 172.21.15.5:0/3250197556 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc638046070 con 0x7fc64c144e80 2024-04-26T22:04:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.963+0000 7fc642a00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc62c06c920 0x7fc62c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.963+0000 7fc642a00640 1 -- 172.21.15.5:0/3250197556 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7fc6380ac7a0 con 0x7fc64c144e80 2024-04-26T22:04:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.964+0000 7fc64aa00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc62c06c920 0x7fc62c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.965+0000 7fc64aa00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc62c06c920 0x7fc62c06ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc63c005500 tx=0x7fc63c007f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:24.968+0000 7fc642a00640 1 -- 172.21.15.5:0/3250197556 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc64c0b6f90 con 0x7fc64c144e80 2024-04-26T22:04:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.188+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc64c075db0 con 0x7fc64c144e80 2024-04-26T22:04:25.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.735+0000 7fc642a00640 1 -- 172.21.15.5:0/3250197556 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fc6380333b0 con 0x7fc64c144e80 2024-04-26T22:04:25.736 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' removed 2024-04-26T22:04:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.739+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc62c06c920 msgr2=0x7fc62c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.739+0000 7fc64be00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc62c06c920 0x7fc62c06ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc63c005500 tx=0x7fc63c007f10 comp rx=0 tx=0).stop 2024-04-26T22:04:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.739+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc64c144e80 msgr2=0x7fc64c1ddc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.739+0000 7fc64be00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc64c144e80 0x7fc64c1ddc70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc63802a8d0 tx=0x7fc6380046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.740+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 shutdown_connections 2024-04-26T22:04:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.740+0000 7fc64be00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc64c1ce930 0x7fc64c1cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.740+0000 7fc64be00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:6832/2672338158,v1:172.21.15.112:6833/2672338158] conn(0x7fc62c06c920 0x7fc62c06ede0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc63c005500 tx=0x7fc63c007f10 comp rx=0 tx=0).stop 2024-04-26T22:04:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.740+0000 7fc64be00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc64c144e80 0x7fc64c1ddc70 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc63802a8d0 tx=0x7fc6380046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.740+0000 7fc64be00640 1 --2- 172.21.15.5:0/3250197556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc630003fd0 0x7fc64c0bcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.740+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 >> 172.21.15.5:0/3250197556 conn(0x7fc64c0686c0 msgr2=0x7fc64c0bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.742+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 shutdown_connections 2024-04-26T22:04:25.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-26T22:04:25.742+0000 7fc64be00640 1 -- 172.21.15.5:0/3250197556 wait complete. 2024-04-26T22:04:25.776 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T22:04:25.776 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:04:25.776 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:25.812 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:04:25.812 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:04:25.813 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:25.834 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:04:25.835 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T22:04:25.835 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T22:04:25.835 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:31.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T22:04:31.937 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T22:04:31.937 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T22:04:31.937 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:32.033 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T22:04:32.034 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T22:04:32.034 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:37.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-26T22:04:37.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T22:04:38.136 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T22:04:38.136 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T22:04:38.136 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:40.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:04:40.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:04:43.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T22:04:43.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-26T22:04:44.237 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T22:04:44.238 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T22:04:44.238 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:48.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-26T22:04:48.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T22:04:50.339 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T22:04:50.340 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T22:04:50.340 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:50.436 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T22:04:50.436 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T22:04:50.436 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:54.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-26T22:04:54.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-26T22:04:56.538 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T22:04:56.539 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T22:04:56.539 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:56.637 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T22:04:56.637 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T22:04:56.637 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T22:04:56.638 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:59.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-26T22:04:59.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-26T22:05:02.739 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T22:05:02.739 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T22:05:02.740 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:02.824 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T22:05:02.825 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T22:05:02.825 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T22:05:02.825 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:02.866 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T22:05:02.866 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T22:05:02.866 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:02.904 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T22:05:02.905 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T22:05:02.905 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:02.972 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T22:05:02.973 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T22:05:02.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-26T22:05:03.161 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T22:05:03.161 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T22:05:03.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T22:05:03.413 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T22:05:03.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T22:05:03.610 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T22:05:03.749 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T22:05:03.749 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T22:05:03.934 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T22:05:03.934 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T22:05:04.218 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T22:05:04.218 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T22:05:04.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T22:05:04.374 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T22:05:04.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T22:05:04.534 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T22:05:04.724 INFO:tasks.ceph:Archiving mon data... 2024-04-26T22:05:04.725 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/data/mon.a.tgz 2024-04-26T22:05:04.726 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-04-26T22:05:04.799 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.oyLZTJVxdJ 2024-04-26T22:05:04.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oyLZTJVxdJ 2024-04-26T22:05:04.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-26T22:05:04.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.oyLZTJVxdJ 2024-04-26T22:05:05.150 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.oyLZTJVxdJ is 312KB 2024-04-26T22:05:05.265 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.oyLZTJVxdJ 2024-04-26T22:05:05.323 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/data/mon.b.tgz 2024-04-26T22:05:05.323 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-26T22:05:05.380 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.CsKUWXmGs2 2024-04-26T22:05:05.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.CsKUWXmGs2 2024-04-26T22:05:05.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.CsKUWXmGs2 2024-04-26T22:05:05.696 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.CsKUWXmGs2 is 317KB 2024-04-26T22:05:05.805 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.CsKUWXmGs2 2024-04-26T22:05:05.860 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/data/mon.c.tgz 2024-04-26T22:05:05.860 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-26T22:05:05.911 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.08yPAXhNz5 2024-04-26T22:05:05.912 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.08yPAXhNz5 2024-04-26T22:05:06.066 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.08yPAXhNz5 2024-04-26T22:05:06.203 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.08yPAXhNz5 is 317KB 2024-04-26T22:05:06.305 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.08yPAXhNz5 2024-04-26T22:05:06.361 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T22:05:06.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T22:05:06.369 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T22:05:06.515 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T22:05:06.572 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T22:05:06.572 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T22:05:06.574 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/remote/smithi005/crash 2024-04-26T22:05:06.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T22:05:06.666 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/remote/smithi112/crash 2024-04-26T22:05:06.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T22:05:06.751 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T22:05:06.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:06.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:06.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:06.989 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:07.079 INFO:tasks.ceph:Compressing logs... 2024-04-26T22:05:07.079 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T22:05:07.087 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T22:05:07.178 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T22:05:07.179 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33237.log 2024-04-26T22:05:07.180 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T22:05:07.181 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33284.log 2024-04-26T22:05:07.182 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T22:05:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33284.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T22:05:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T22:05:07.185 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33324.log 2024-04-26T22:05:07.186 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T22:05:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33404.log 2024-04-26T22:05:07.188 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-04-26T22:05:07.189 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33444.log 2024-04-26T22:05:07.190 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33364.log 2024-04-26T22:05:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33444.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T22:05:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33364.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T22:05:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T22:05:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33153.log 2024-04-26T22:05:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T22:05:07.204 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33153.log: /var/log/ceph/ceph-mon.b.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T22:05:07.210 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41189.log 2024-04-26T22:05:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40685.log 2024-04-26T22:05:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41105.log 2024-04-26T22:05:07.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38336.log 2024-04-26T22:05:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46946.log 2024-04-26T22:05:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2024-04-26T22:05:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46946.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46946.log.gz 2024-04-26T22:05:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40045.log 2024-04-26T22:05:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46257.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz 2024-04-26T22:05:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46215.log 2024-04-26T22:05:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40769.log 2024-04-26T22:05:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46341.log 88.9% 2024-04-26T22:05:07.222 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46215.log.gz 2024-04-26T22:05:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46988.log 2024-04-26T22:05:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46341.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46341.log.gz -5 2024-04-26T22:05:07.224 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39311.log 2024-04-26T22:05:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46988.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46988.log.gz -5 2024-04-26T22:05:07.225 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37535.log 2024-04-26T22:05:07.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46904.log 2024-04-26T22:05:07.227 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41189.log.gz 2024-04-26T22:05:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37535.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40769.log.gz 2024-04-26T22:05:07.228 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39732.log 2024-04-26T22:05:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41021.log 2024-04-26T22:05:07.230 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39732.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46904.log.gz 2024-04-26T22:05:07.231 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41317.log 2024-04-26T22:05:07.232 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39729.log 2024-04-26T22:05:07.233 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38939.log 2024-04-26T22:05:07.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39729.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40045.log.gz 88.2% 2024-04-26T22:05:07.234 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41317.log.gz 2024-04-26T22:05:07.234 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38813.log 2024-04-26T22:05:07.235 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45315.log 2024-04-26T22:05:07.236 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37449.log 2024-04-26T22:05:07.237 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45315.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45315.log.gz 2024-04-26T22:05:07.237 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T22:05:07.238 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37449.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39732.log.gz 2024-04-26T22:05:07.238 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37491.log 2024-04-26T22:05:07.239 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39729.log.gz 2024-04-26T22:05:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2024-04-26T22:05:07.240 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40038.log 2024-04-26T22:05:07.241 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45273.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2024-04-26T22:05:07.241 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2024-04-26T22:05:07.242 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40038.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.38336.log.gz 2024-04-26T22:05:07.242 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T22:05:07.243 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T22:05:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46654.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2024-04-26T22:05:07.244 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37189.log 2024-04-26T22:05:07.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45433.log 2024-04-26T22:05:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2024-04-26T22:05:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45433.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2024-04-26T22:05:07.248 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46173.log 2024-04-26T22:05:07.248 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38813.log.gz 2024-04-26T22:05:07.248 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38939.log.gz 2024-04-26T22:05:07.249 INFO:teuthology.orchestra.run.smithi112.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33153.log.gz 2024-04-26T22:05:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37029.log 2024-04-26T22:05:07.250 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2024-04-26T22:05:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46173.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40038.log.gz 2024-04-26T22:05:07.250 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40685.log.gz 2024-04-26T22:05:07.250 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46173.log.gz 2024-04-26T22:05:07.250 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45189.log 2024-04-26T22:05:07.251 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-04-26T22:05:07.251 INFO:teuthology.orchestra.run.smithi112.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33237.log.gz 2024-04-26T22:05:07.251 INFO:teuthology.orchestra.run.smithi112.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33284.log.gz 2024-04-26T22:05:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45601.log 2024-04-26T22:05:07.253 INFO:teuthology.orchestra.run.smithi112.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33324.log.gz 2024-04-26T22:05:07.253 INFO:teuthology.orchestra.run.smithi112.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33364.log.gz 2024-04-26T22:05:07.253 INFO:teuthology.orchestra.run.smithi112.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33404.log.gz 2024-04-26T22:05:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45189.log: gzip -5 87.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45189.log.gz 2024-04-26T22:05:07.253 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph.audit.log 2024-04-26T22:05:07.254 INFO:teuthology.orchestra.run.smithi112.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33444.log.gz 2024-04-26T22:05:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2024-04-26T22:05:07.255 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45601.log.gz 2024-04-26T22:05:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38981.log 2024-04-26T22:05:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39724.log 2024-04-26T22:05:07.256 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2024-04-26T22:05:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-04-26T22:05:07.257 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39311.log.gz 2024-04-26T22:05:07.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39724.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38981.log.gz 2024-04-26T22:05:07.257 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39023.log 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46509.log 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39724.log.gz 2024-04-26T22:05:07.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40517.log 2024-04-26T22:05:07.260 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39023.log.gz 2024-04-26T22:05:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46509.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46509.log.gz 2024-04-26T22:05:07.261 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-04-26T22:05:07.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2024-04-26T22:05:07.262 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40517.log.gz 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46593.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46862.log 2024-04-26T22:05:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2024-04-26T22:05:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39227.log 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46862.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25390.log 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46862.log.gz 2024-04-26T22:05:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39227.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41021.log.gz 2024-04-26T22:05:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45825.log 2024-04-26T22:05:07.267 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41105.log.gz 2024-04-26T22:05:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.25390.log: 0.0% 88.5% -- replaced with /var/log/ceph/ceph.tmp-client.admin.25390.log.gz -- replaced with /var/log/ceph/ceph-client.admin.39227.log.gz 2024-04-26T22:05:07.268 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-26T22:05:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39143.log 2024-04-26T22:05:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45825.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45825.log.gz 2024-04-26T22:05:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40035.log 2024-04-26T22:05:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36952.log 2024-04-26T22:05:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38545.log 2024-04-26T22:05:07.271 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39143.log.gz 2024-04-26T22:05:07.271 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40035.log.gz 2024-04-26T22:05:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2024-04-26T22:05:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38897.log 2024-04-26T22:05:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40331.log 2024-04-26T22:05:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38897.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T22:05:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40331.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T22:05:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40643.log 2024-04-26T22:05:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T22:05:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40304.log 2024-04-26T22:05:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39713.log 2024-04-26T22:05:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2024-04-26T22:05:07.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log 2024-04-26T22:05:07.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46467.log 2024-04-26T22:05:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40937.log 2024-04-26T22:05:07.282 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38545.log.gz 2024-04-26T22:05:07.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46467.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2024-04-26T22:05:07.283 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45231.log 2024-04-26T22:05:07.283 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46467.log.gz 2024-04-26T22:05:07.284 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45559.log 2024-04-26T22:05:07.284 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37189.log.gz 2024-04-26T22:05:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45231.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-04-26T22:05:07.285 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38897.log.gz 2024-04-26T22:05:07.286 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45231.log.gz 2024-04-26T22:05:07.286 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40331.log.gz 2024-04-26T22:05:07.286 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40643.log.gz 2024-04-26T22:05:07.286 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40304.log.gz 2024-04-26T22:05:07.286 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40036.log 2024-04-26T22:05:07.286 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39713.log.gz 2024-04-26T22:05:07.286 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2024-04-26T22:05:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45559.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40937.log.gz 2024-04-26T22:05:07.287 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45559.log.gz 2024-04-26T22:05:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39525.log 2024-04-26T22:05:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41063.log 2024-04-26T22:05:07.288 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40036.log.gz 2024-04-26T22:05:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45105.log 2024-04-26T22:05:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41063.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39525.log.gz 2024-04-26T22:05:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37619.log 2024-04-26T22:05:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37787.log 2024-04-26T22:05:07.290 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45105.log.gz 2024-04-26T22:05:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41727.log 2024-04-26T22:05:07.291 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41063.log.gz 2024-04-26T22:05:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37787.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T22:05:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.41727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45918.log 2024-04-26T22:05:07.293 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37787.log.gz 2024-04-26T22:05:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39730.log 2024-04-26T22:05:07.295 INFO:teuthology.orchestra.run.smithi112.stderr: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T22:05:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37661.log 2024-04-26T22:05:07.295 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45918.log.gz 2024-04-26T22:05:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2024-04-26T22:05:07.296 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-04-26T22:05:07.297 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40364.log 2024-04-26T22:05:07.298 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39730.log.gz 2024-04-26T22:05:07.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39269.log 2024-04-26T22:05:07.299 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37449.log.gz 2024-04-26T22:05:07.299 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37491.log.gz 2024-04-26T22:05:07.299 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37535.log.gz 2024-04-26T22:05:07.299 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2024-04-26T22:05:07.303 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2024-04-26T22:05:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40364.log.gz 2024-04-26T22:05:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40317.log 2024-04-26T22:05:07.303 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39269.log.gz 2024-04-26T22:05:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39722.log 2024-04-26T22:05:07.303 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2024-04-26T22:05:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37577.log 2024-04-26T22:05:07.304 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39722.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40317.log.gz 2024-04-26T22:05:07.304 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37235.log 2024-04-26T22:05:07.304 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40601.log 2024-04-26T22:05:07.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39723.log 2024-04-26T22:05:07.305 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39722.log.gz 2024-04-26T22:05:07.306 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39395.log 2024-04-26T22:05:07.306 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37577.log.gz 2024-04-26T22:05:07.307 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2024-04-26T22:05:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39480.log 2024-04-26T22:05:07.309 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38713.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37235.log.gz 2024-04-26T22:05:07.309 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40065.log 2024-04-26T22:05:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39480.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40601.log.gz 2024-04-26T22:05:07.310 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39723.log.gz 2024-04-26T22:05:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40895.log 2024-04-26T22:05:07.310 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39395.log.gz 2024-04-26T22:05:07.311 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2024-04-26T22:05:07.311 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39480.log.gz 2024-04-26T22:05:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2024-04-26T22:05:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40895.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40065.log.gz 2024-04-26T22:05:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46694.log 2024-04-26T22:05:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46551.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz 2024-04-26T22:05:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-04-26T22:05:07.313 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-04-26T22:05:07.314 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40895.log.gz 2024-04-26T22:05:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-04-26T22:05:07.314 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46694.log.gz 2024-04-26T22:05:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37703.log 2024-04-26T22:05:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39185.log 2024-04-26T22:05:07.316 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37661.log.gz 2024-04-26T22:05:07.316 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37619.log.gz 2024-04-26T22:05:07.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46131.log 2024-04-26T22:05:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39185.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37703.log.gz 2024-04-26T22:05:07.318 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40333.log 2024-04-26T22:05:07.318 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39185.log.gz 2024-04-26T22:05:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46383.log 2024-04-26T22:05:07.319 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46131.log.gz 2024-04-26T22:05:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40559.log 2024-04-26T22:05:07.320 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40333.log.gz 2024-04-26T22:05:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45475.log 2024-04-26T22:05:07.321 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46383.log.gz 2024-04-26T22:05:07.321 INFO:teuthology.orchestra.run.smithi005.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-04-26T22:05:07.321 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40055.log 2024-04-26T22:05:07.321 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40559.log.gz 2024-04-26T22:05:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39353.log 2024-04-26T22:05:07.323 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45475.log.gz 2024-04-26T22:05:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37745.log 2024-04-26T22:05:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38755.log 2024-04-26T22:05:07.325 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40055.log.gz 2024-04-26T22:05:07.325 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39353.log.gz 2024-04-26T22:05:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-04-26T22:05:07.325 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37745.log.gz 2024-04-26T22:05:07.326 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38671.log 2024-04-26T22:05:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37895.log 2024-04-26T22:05:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46425.log 2024-04-26T22:05:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40853.log 2024-04-26T22:05:07.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46736.log 2024-04-26T22:05:07.330 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46425.log.gz 2024-04-26T22:05:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37363.log 2024-04-26T22:05:07.332 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38755.log.gz 2024-04-26T22:05:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45734.log 2024-04-26T22:05:07.332 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46736.log.gz 2024-04-26T22:05:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-04-26T22:05:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40811.log 2024-04-26T22:05:07.334 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45734.log.gz 2024-04-26T22:05:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38629.log 2024-04-26T22:05:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2024-04-26T22:05:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39101.log 2024-04-26T22:05:07.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45391.log 2024-04-26T22:05:07.338 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz 2024-04-26T22:05:07.338 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40475.log 2024-04-26T22:05:07.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2024-04-26T22:05:07.339 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45391.log.gz 2024-04-26T22:05:07.340 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45783.log 2024-04-26T22:05:07.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45868.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T22:05:07.341 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2024-04-26T22:05:07.342 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2024-04-26T22:05:07.342 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45783.log.gz 2024-04-26T22:05:07.342 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37829.log 2024-04-26T22:05:07.343 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-04-26T22:05:07.343 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39731.log 2024-04-26T22:05:07.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45147.log 2024-04-26T22:05:07.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40979.log 2024-04-26T22:05:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40033.log 2024-04-26T22:05:07.346 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45147.log.gz 2024-04-26T22:05:07.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46778.log 2024-04-26T22:05:07.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45517.log 2024-04-26T22:05:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46778.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38671.log.gz 2024-04-26T22:05:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40068.log 2024-04-26T22:05:07.350 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46778.log.gz 2024-04-26T22:05:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32859.log 2024-04-26T22:05:07.350 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45517.log.gz 2024-04-26T22:05:07.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39437.log 2024-04-26T22:05:07.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46820.log 2024-04-26T22:05:07.352 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37895.log.gz 2024-04-26T22:05:07.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46047.log 2024-04-26T22:05:07.353 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40853.log.gz 2024-04-26T22:05:07.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37277.log 2024-04-26T22:05:07.353 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46820.log.gz 2024-04-26T22:05:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46047.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46047.log.gz 2024-04-26T22:05:07.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37277.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37363.log.gz 2024-04-26T22:05:07.359 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-04-26T22:05:07.360 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40811.log.gz 2024-04-26T22:05:07.360 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39101.log.gz 2024-04-26T22:05:07.360 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38629.log.gz 2024-04-26T22:05:07.360 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40475.log.gz 2024-04-26T22:05:07.361 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2024-04-26T22:05:07.362 INFO:teuthology.orchestra.run.smithi005.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39731.log.gz 2024-04-26T22:05:07.362 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40033.log.gz 2024-04-26T22:05:07.362 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40068.log.gz 2024-04-26T22:05:07.362 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40979.log.gz 88.2% 2024-04-26T22:05:07.362 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39437.log.gz 2024-04-26T22:05:07.362 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37277.log.gz 2024-04-26T22:05:07.382 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32859.log.gz 2024-04-26T22:05:07.443 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36952.log.gz 2024-04-26T22:05:07.443 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37029.log.gz 2024-04-26T22:05:07.443 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-04-26T22:05:07.443 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-04-26T22:05:07.506 INFO:teuthology.orchestra.run.smithi005.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T22:05:07.985 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37829.log.gz 2024-04-26T22:05:08.133 INFO:teuthology.orchestra.run.smithi005.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T22:05:08.710 INFO:teuthology.orchestra.run.smithi112.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T22:05:09.642 INFO:teuthology.orchestra.run.smithi112.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T22:05:11.102 INFO:teuthology.orchestra.run.smithi112.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T22:05:19.261 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T22:05:53.303 INFO:teuthology.orchestra.run.smithi112.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T22:05:56.882 INFO:teuthology.orchestra.run.smithi112.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T22:06:01.970 INFO:teuthology.orchestra.run.smithi112.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T22:06:03.042 INFO:teuthology.orchestra.run.smithi112.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T22:06:05.305 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T22:06:19.596 INFO:teuthology.orchestra.run.smithi112.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T22:06:19.600 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-04-26T22:06:19.600 INFO:teuthology.orchestra.run.smithi112.stderr:real 1m12.460s 2024-04-26T22:06:19.600 INFO:teuthology.orchestra.run.smithi112.stderr:user 3m16.716s 2024-04-26T22:06:19.600 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m17.846s 2024-04-26T22:06:22.421 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T22:06:40.438 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T22:06:43.899 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T22:10:25.133 INFO:teuthology.orchestra.run.smithi005.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.41727.log.gz 2024-04-26T22:10:25.137 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-26T22:10:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:real 5m18.002s 2024-04-26T22:10:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:user 6m26.982s 2024-04-26T22:10:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m37.663s 2024-04-26T22:10:25.139 INFO:tasks.ceph:Archiving logs... 2024-04-26T22:10:25.139 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/remote/smithi005/log 2024-04-26T22:10:25.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T22:11:18.450 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/remote/smithi112/log 2024-04-26T22:11:18.451 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T22:12:18.483 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T22:12:18.492 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T22:12:18.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T22:12:18.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T22:12:18.646 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T22:12:18.655 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T22:12:18.656 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:12:18.663 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:12:18.713 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-04-26T22:12:18.718 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-26T22:12:18.752 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T22:12:18.752 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-26T22:12:18.752 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +1525us[+1784us] +/- 42ms 2024-04-26T22:12:18.753 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 +51us[ +51us] +/- 59ms 2024-04-26T22:12:18.753 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -2357us[-2357us] +/- 69ms 2024-04-26T22:12:18.753 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T22:12:18.772 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T22:12:18.772 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-26T22:12:18.772 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +1487us[+1762us] +/- 42ms 2024-04-26T22:12:18.772 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 +57us[ +332us] +/- 59ms 2024-04-26T22:12:18.772 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -2352us[-2077us] +/- 69ms 2024-04-26T22:12:18.772 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T22:12:18.775 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T22:12:18.784 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T22:12:18.785 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T22:12:18.793 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T22:12:19.046 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T22:12:19.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T22:12:19.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:12:19.350 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T22:12:19.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:12:19.440 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T22:12:19.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T22:12:19.461 INFO:teuthology.task.internal:Duration was 2638.224412 seconds 2024-04-26T22:12:19.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T22:12:19.472 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T22:12:19.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T22:12:19.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T22:12:19.627 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T22:12:19.666 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T22:12:20.229 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T22:12:20.229 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-04-26T22:12:20.230 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T22:12:20.301 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T22:12:20.301 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T22:12:20.377 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T22:12:20.377 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T22:12:20.385 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T22:12:20.472 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T22:12:20.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T22:12:20.477 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T22:12:20.701 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T22:12:20.711 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T22:12:20.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T22:12:20.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T22:12:20.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T22:12:20.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:12:20.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:12:21.030 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-04-26T22:12:21.045 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-04-26T22:12:21.094 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:12:21.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:12:21.147 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:12:21.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:12:21.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T22:12:21.214 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T22:12:21.216 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/remote/smithi005 2024-04-26T22:12:21.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T22:12:21.317 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675220/remote/smithi112 2024-04-26T22:12:21.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T22:12:21.413 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T22:12:21.413 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T22:12:21.421 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T22:12:21.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T22:12:21.487 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T22:12:21.487 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T22:12:21.496 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T22:12:21.497 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T22:12:21.502 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T22:12:21.555 INFO:teuthology.orchestra.run.smithi005.stdout: 393251 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 22:12 /home/ubuntu/cephtest 2024-04-26T22:12:21.558 INFO:teuthology.orchestra.run.smithi112.stdout: 393940 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 22:12 /home/ubuntu/cephtest 2024-04-26T22:12:21.560 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T22:12:21.571 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T22:12:21.594 INFO:teuthology.run:Summary data: description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc} duration: 2638.2244119644165 flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology success: true 2024-04-26T22:12:21.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T22:12:21.668 INFO:teuthology.run:pass